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Introduction 


Tbe  Military  Operatioas  Reaearch  Society  (MORS)  ^Kxuored  a  workshop  on  Future  Wargaming 
Devdopmems  (FWD  >  December  S-7,  19^,  at  the  Naval  War  (College  in  Newport,  RL  The  Navy 
(Dhector  of  Ptogr-  a  Resource  ^ipraiaal,  O^e  of  the  Chief  of  Naval  Operatioos)  and  Army  (Deputy 
Under  Secretary  of  the  Army  for  Operations  Research)  Sponsors  of  MORS  were  proponents  for  this 
Workdiop.  MORS  Sponson  were  Mefed  on  the  Worksi^’s  findings  on  21  Febraary  1990. 

The  body  of  this  rqwrt.  written  by  the  Workshop  Chair,  sununarizes  the  Woricshop’s  findings,  largely 
as  briefed  to  the  MORS  Sponsm.  Substance  of  the  Workshop’s  iSndings  is  contained  in  the 
Aiipendixes.  The  first  Appendix,  written  by  the  Wwkshop  Chairman,  describes  the  structure  and 
procedures  of  dm  Workshop.  The  next  four  Appendixes  summarize  discussions  and  findings  from  the 
four  individual  groups.  Each  was  written  by  tte  grmip’s  Co-Chain  as  a  separate,  stand-alone  piece 
focused  on  Ae  group’s  topic.  The  next  Appendix  doctunents  the  perspective  of  the  Synthesis  Panel, 
written  by  one  of  the  panelists. 


Distiibutioo  (rf  the  74  Woriahr^  parttcqumts  was  well  balanced  in  terms  of  organizational  representation 
and  military  affiliation,  as  indicated  by  Figure  1  which  also  identifies  the  Workshop’s  leadership.  Tbe 
dozen  MORS  leaden  participating  in  the  Worksht^  included  current  and  former  Board  memben, 
program  chain,  working  groiq>  chain,  etc.  Worksht^  groiq>s  addressed  wargaming  apf^cations  in  1) 
techncdogy  areas,  2)  weapon  system  acquisition  and  manpower  planning,  3)  T&E,  and  4)  advances 
expected  over  the  next  decade  in  hardware  and  software  to  support  wargaming.  A  Synthesis  Panel 
helped  the  four  groiqM  focus  their  deliberatiotu  and  encouraged  them  to  address  issues  of  concern  to 
higher  level  DoD  decisitm  maken.  The  Wotksht^  TOR  was  oriented  toward  wargaming  practitionen 
(both  tiheorists  and  executon)  and  the  immediate  sponsors  of  war  games.  The  Workshop’s  Synthesis 
Panel  provided  an  additiooal  emfdiasis:  the  ne^  to  address  senior  DoD  decision  makos  as  a 
wargaming  audience. 


CHAIR: 
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Figure  1.  Woikshop  Leadership  and  Participants. 
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Workshop  Obje<^ives 


The  Workshop  had  two  objectives:  "To  identify,  define,  and  clarify  (1)  q^ropriate  limitations 
upon  and  cq>abilities  of  waigaming  i^lications  to  the  following  (listed  in  order  of  priority): 

•  Technology  issues  (especially  development  of  the  theory  of  and  guidelines  for  the 
practice  of  "Technology  Gaming"), 

•  Wargaming  use  in  T&E, 

•  System  interactions  in  operational  contexts, 

•  Weapon  acquisition  processes, 

•  Manpower  planning,  and 

(2)  changes  desirable  in  wargaming  processes  because  of  anticipated  hardware  and  software 
advances  within  the  next  S-10  years." 

"Technology  gaming"  is  a  term  coined  m  1988  to  describe  the  analytic  process  employed  in 
the  Navy’s  1988  Technology  Initiatives  Game  (TIG-88)  and  similar  gaming  endeavors.  It  has 
been  defined  formally  as: 

"Technology  gaming,  as  applied  to  military  research,  is  an  analytic  process  that  involves 
knowledgeable  people  in  structured  discussions  about  policies,  strategies,  issues, 
technologies,  systems,  and  military  activities  in  an  operational  context."  -  Dale  K.  Pace 
&.  David  D.  Moran,  'Technology  Gaming."  Naval  Engineers  Journal.  May  1989,  p.  241. 

What  Is  Wargaming? 

"Wargaming"  has  many  connotations.  Some  people  have  very  narrow  views  about  the  scope 
and  value  of  wargaming.  Often  their  views  are  based  upon  a  limited  exposure  to  wargaming. 
Few  people  have  had  much  direct,  personal  experience  with  die  full  spectrum  of  wargaming: 
from  research  oriented  seminar  games  to  large  training  games  in  major  wargaming  facilities, 
from  table  top  manual  games  to  games  with  extensive  computer/display  suppon  and 
interaction,  or  from  gaming  supporting  technology  and  design  issues  for  future  systems  to 
gaming  involved  with  tactics  for  current  systems.  The  scope  of  new  wargaming  applications 
addressed  by  the  Workshop  was  challenging. 

The  Workshop  assumed  a  veiy  broad  definition  for  wargaming.  "Wargaming  is  any  form  of 
research,  analysis,  training,  education,  or  recreation  that  is  intended  to  produce  better 
appreciation  for  or  understanding  of  warfare,  which  involves  people  directly  in  the 
computation/gaming  process  who  function  as  people  in  the  process  or  who  serve  as  a  surrogate 
for  some  odier  analytic  process  (such  as  using  expert  judgment  by  a  game  umpire  to  evaluate 
force  interactions  or  batde  damage)."  The  objective  of  this  broad  connotation  was  to  remove 
the  opportunity  for  quibbling  about  what  is  or  is  not  wargaming.  Closed-form  mathematical 
analyses  and  computer  simulations  which  do  not  have  direct  human  interaction  were  excluded 
by  this  definition. 

The  Workshop  definition  included  man-in-the-loop  simulators  as  a  form  of  wargaming.  In 
response  to  guidance  from  the  MORS’  Army  Sponsor,  computer  simulations  with  AI  programs 
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as  human  surrogates  was  also  included  as  a  form  of  wargaming.  While  diis  functional 
qjproach  to  wargaming  was  useful  for  the  broad  topic  of  the  Worksht^,  some  of  the 
Woikshop’s  groups  restricted  their  discussions  to  less  than  the  full  q>ectrum  of  waigaming 
by  this  definititm  in  order  to  make  die  greatest  progress  in  the  limited  time  of  die  Workshop. 
A  few  Workshop  partic^ants  expressed  concern  that  including  simulators  as  a  form  of 
"wargaming"  could  advosely  affect  funding  for  simulators. 

Wargaming’s  Potential  and  Limitations 

The  potential  of  wargaming  has  been  long  recognized  in  training  and  exploring  various  aspects 
of  military  operations.  Wargaming  now  is  beginning  to  be  iqiplied  more  in  technology, 
acquisition,  and  T&E  domains  in  which  it  has  as  much  potential  utility  as  elsewhere. 

Wargaming  is  especially  valuable  for. 

•  Stimulating  a  better  vision  of  future  warfare, 

•  Creating  frames  of  reference, 

•  Building  consensus  about  significant  issues  such  as  program  need, 

•  Assessing  operational  concepts, 

•  Stimulating  insights  missed  by  other  analytic  forms, 

•  Producing  insights  and  issues  (not  quantitative  results), 

•  Improving  the  judgment  context  undeilying  decisions, 

•  Communicating  across  diverse  technical,  policy,  and  operational  communities,  and 

•  Flexible  analysis  of  problems. 

Wargaming’s  utility  for  developing  a  vision  for  future  warfare  is  q}dy  illustrated  by  Admiral 
Nimitz’s  comment,  "The  war  with  Japan  had  been  reenacted  in  the  game  rooms  at  the  Naval 
War  College  by  so  many  people,  and  in  so  many  different  ways,  that  nothing  that  happened 
during  the  war  was  a  surprise...  absolutely  nothing  except  the  kamikaze  tactics  toward  Ae  end 
of  the  war;  we  had  not  visualized  these."  (Naval  War  College  Catalog).  More  recently,  the 
Under  Secretary  of  Defense  noted  diat  the  ASAT  Cost  and  Operational  Efiectiveness  Analysis 
(which  used  seminar  gaming  as  its  main  analysis  process)  "played  a  central  role  in  establishing 
potential  effectiveness  of  ASAT  system  can^dates  and  in  building  program-need  consensus." 
(Memorandum  for  the  Secretaries  of  die  Military  Departments,  15  Dec  89).  The  current, 
nqiidly  changing  security  environment,  with  its  many  new  and  dynamic  aspects,  gives  added 
importance  to  wargaming  as  a  flexible  means  of  illuminating  the  fiiture  significance  of  defense 
choices  and  of  communicating  such  across  community  boundaries  within  the  defense 
establishment.  Because  the  most  significant  national  decisions  are  too  complex  for  our 
optimization  procedures,  ultimately  these  decisions  are  based  upon  judgment.  Wargaming  can 
produce  many  insights  that  facilitate  better  judgment  about  these  problems. 

War  games  are  especially  advantageous  for  assessing  conqilex  interactions,  issues,  and  ideas 
that  still  have  considerable  ambiguity.  Wargaming’s  benefits  mostly  result  from  their  high 
degree  of  human  partic^ation  in  the  process  and  accrue  mainly  to  war  game  participants. 
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which  gives  q)ecial  inqMrtance  to  participation  in  war  games  by  those  who  need  the  broad 
judgment  basis  for  high  level  policy  decisions. 

In  addition  to  wargaming’s  utility,  the  Workshop  also  addressed  wargaming’s  limitations  and 
potential  abuses.  These  same  limitations  and  potential  abuses  also  i^ly  to  other  forms  of 
analysis,  including  con:q>uter  simulations  and  other  ^roaches  that  are  considered  to  be  more 
"quantitative"  than  wargaming.  These  limitations  and  potential  abuses  fall  into  two  broad 
categories*  1)  bureaucratic,  administrative,  and  management  ones;  and  2)  technical  ones. 

Bureaucratic/Administrative/Management  Limitations  and  Potential  Abuses: 

•  Mismatch  of  game  design  and  objectives, 

•  Inappropriate  constraints  and  artificialities, 

•  Wrong  problem  and/or  wrong  participants, 

•  Misuse  of  results,  and 

•  Technical  seduction 

—  excessive  expectations  of  wargaming,  and 

—  use  of  models  without  foil  understanding  of  them. 

Technical  Limitations  and  Potential  Abuses: 

•  Inadequate  models/data/Bdelity/resolution, 

•  Limited  ctqmite  of  decision  rationale, 

•  Resource  (people/doUars/time)  intensive, 

•  Hardware/softwate  incompatibilities,  and 

•  The  "single  data  point"  nature  of  a  war  game. 


War  games  are  often  considered  a  single  data  point,  yet  a  war  game  produces  much  more  than 
its  outcome  —  it  provides  a  context  for  each  outcome,  the  kind  of  important  context  which 
may  be  lacking  in  results  from  multiple  iterations  of  a  stochastic  model  in  a  conqruter 
simulation.  When  conunand  processes  are  treated  carefully  in  an  analysis,  war  games  and 
Monte  Carlo  simulations  are  likely  to  produce  very  similar  results  (suggested  by  Pete  Shugart’s 
1987  paper  on  utility  of  war  games,  ATRC-WD-1).  Hardware  and  software  advances  may 
overcome  some  of  the  resource  requirements  and  incompatibUities  of  current  wargaming,  but 
those  same  advances  may  engender  excessive  expectations  by  users  and  participants  of  war 
games  as  well  as  making  it  easier  for  war  gamers  to  combine  models  together  in  a  war  game 
without  foil  understanding  of  the  models. 

A.  Wargaming  &  Technology  Issues 

Technology  wargaming  is  one  of  the  valuable  tools  available  to  the  research,  development,  and 
acquisition  community.  Technology  wargaming  has  been  used  to  help  focus  technology  base 
investment  strategy,  to  educate  techbase  managers  about  the  relationships  between  technology. 
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strategy,  tactics,  and  scenarios,  and  to  expose  milhaiy  personnel  to  the  potential  of  advanced 
technology.  The  utility  of  a  particular  war  game  is  critically  depoukmt  uprni  die 
qipropriateness  of  its  8cenario(s)  and  participants  as  well  as  the  focus  of  the  game’s 
objective(s).  It  is  inqiottant  for  foture  wargaming  developments  to  make  it  possible  to  achieve 
a  war  game’s  objective  with  less  maiqxiwer  costs  or  some  needed  wargaming  q^ilicatious  will 
not  be  possible  because  of  cost  considerations. 

Thoe  ate  two  major  limitations  of  technology  wargaming.  The  first  is  the  limited  number  of 
data  points  that  wargaming  produces  since  each  war  game  is  essentially  a  single  data  point 
which  is  very  difficult  to  repeat.  The  second  limitation  is  the  lack  of  a  rigorous  theory  or 
calculus  of  wargaming.  Progress  in  development  of  wargaming  theory  will  make  this  tool 
even  mote  useful  in  the  technology  arena. 

A  specific  task  of  the  Technology  Group  of  the  Workshop  was  to  critique  the  Methodology 
CeU  report  of  the  Navy’s  1989  Technology  Initiatives  Game  (TIG-89)  (Naval  War  College 
Report,  Technology  Initiatives  89  Game  Methodology  Oil  Report.  15  September  1989).  This 
report  addressed  technology  gaming’s  role  in  R&D  planning  and  provided  practical  guidance 
related  to  the  conduct  of  technology  gaming.  The  Workshop’s  Technology  Group  endorsed 
this  report  and  its  findings,  which  include  die  following  points: 

•  Because  technology  must  be  represented  through  systems  and  operational  concepts  in 
watgaming,  the  value  of  a  technology  may  be  obscured  by  the  quality  of  die  systems 
and  operational  concepts  representing  it,  both  in  absolute  terms  and  relative  to  the  quality 
of  o^er  system  descrqitions  and  operational  concepts.  Poorly  developed  system 
descriptions  and  concepts  of  operation  may  mislead  in  both  positive  and  negative 
directions  about  a  technology’s  fiiture  value. 

•  The  products  of  technology  gaming  can  focus  upon  insights  about  systems,  operational 
concepts,  scenarios,  or  a  combination  of  these  in  a  particular  war  game  or  set  of  war 
games.  Having  the  right  people  in  dw  game  is  always  paramount.  It  is  important  to 
include  all  pertinent  communities  in  tectoology  gaming  in  order  to  produce  the  most 
significant  contributions  to  development  of  R&D  investment  strategies.  These 
communities  include  policy  personnel,  R&D  managers,  technologists,  analysts,  military 
operators,  and  crucial  technology  decision  makers. 

B.  Wargaming  &  System  Acquisition 

Weqx>n  system  acquisition  extends  from  the  initial  ideas  for  a  ^stem  (mission  area 
aiuilysis/concept  formulation)  to  its  removal  from  service  at  the  end  of  the  system’s  life  cycle. 
The  system  includes  its  equipment,  all  aspects  of  manpower,  personnel,  and  training  (MPT) 
for  the  system,  and  its  logistic  support.  Wargaming  af^lications  to  system  acquisition  tend 
to  fall  into  two  general  classes:  conceptual  war  games  at  the  front  end  of  the  acquisition 
process,  and  system-focused  war  games  after  trade-offs.  Wargaming,  when  sqjplied  to  future 
systems,  can  provide  insights  about  acquisition  choices  while  those  choices  still  exist.  The 
perspectives  and  frames  of  reference  that  wargaming  can  provide  have  the  potential  to  improve 
decision  maker  judgmoit  in  acquisition  decisions  as  well  as  clarifying  many  issues  related  to 
acquisition  decisions.  Failute  to  identify,  clarify,  and  resolve  all  significant  issues  early  can 
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lead  to  delays  and  amfiision  in  program  prosecution  and  implementation.  Wargaming  which 
involves  senior  decisicm  makers  and  decision  shapers  has  great  potential  to  idmtify,  clarify, 
and  resolve  such  issues  so  that  more  consensus  can  be  obtain^  about  mission  need  and 
requitemeaits  as  well  as  potential  system  utility.  This,  in  turn,  can  reduce  acquisititm  time  and 
cost.  While  acquisition  war  games  provide  a  common  language  among  differait  elements  of 
the  acquisition  community,  there  remain  a  number  of  areas  in  which  wargaming  has  much 
room  for  inq>rovement: 

•  Setting  the  proper  objectives, 

•  Designing  games  to  obtain  desired  data, 

•  Constructing  data  bases  required  for  a  war  game,  and 

•  Distilling  the  results  into  a  meaningful  set  of  value  to  the  decision-maker. 

This  identifies  several  areas  where  additional  research  is  rreeded:  how  to  apply  seminar  games 
better  to  acquisition  problems  and  how  to  better  conduct  the  post-game  phase  of  war  games. 

C.  Wargaming’s  Role  in  T&E 

As  advanced  weiqron  systems  become  more  complex  and  may  involve  multiple  units,  T&E 
becomes  mote  difficult,  especially  as  more  oivirorunental  and  political  restrictions  are  placed 
upon  test  areas  and  conditions.  In  some  key  situations,  computer  simulations  are  not  always 
able  to  predict  system  performance  and  acceptable  operational  circumstances.  Wargaming, 
with  its  analytic  flexibility,  can  help  explore  appropriate  tactics  and  operational  concepts  for 
systems  in  a  wide  variety  of  scenarios,  identifying  critical  technical  and  operational  issues,  and 
providing  a  context  for  extrapolation  of  simulation  as  well  as  T&E  results.  This  will  allow 
T&E  to  focus  upon  the  most  significant  aspects  of  system  ciq>abilities  and  save  hardware  for 
the  most  significant  tests.  Of  particular  inqx)rtance  is  use  of  wargaming  for  illuminating 
human  decision  processes  of  the  system  as  it  undergoes  T&E.  In  addition,  wargaming  of 
systems  as  alternative  for  some  T&E  may  limit  potential  intelligence  exploitation  opportunities. 
These  applications  of  wargaming  could  inqtrove  the  T&E  process. 

D.  Wargaming  &  Highly  Classified  Data 

The  Workshop  was  tasked  with  addressing  the  issue  of  how  highly  classified  data  (i.e.,  any 
data  of  a  higher  classification  than  the  general  classification  of  the  game  itself)  should  be 
treated  in  wargaming.  The  problem  of  highly  classified  data  is  more  severe  for  T&E  than  for 
most  other  applications  of  wargaming  because  in  many  situations  a  relative  answer  is  adequate 
for  the  purposes  of  the  analysis  or  training,  but  not  in  T&E  when  the  war  game  must  have 
an  absolute  calibration  in  order  to  interface  effectively  with  T&E.  (Even  the  most  highly 
classified  systems  have  to  go  through  T&E.) 

This  problem  can  always  be  solved  administratively,  at  least  in  theory,  by  granting  sqrpropriate 
clearances  to  all  who  need  to  be  involved  in  the  war  game.  Other  ways  of  dealing  with  this 
problem  include:  having  a  higher  classification  off-line  cell  which  produces  irq>ut  for  the 
game  which  has  been  sanitized  to  the  classification  level  of  the  game;  having  war  game  results 
reviewed  by  knowledgeable  people  with  the  higher  classification  clearances;  or  by  using 
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parameter  bounding  instead  of  real  data  to  avoid  tbe  essence  of  die  higher  classificatitm  issu^. 
None  of  these  api»oaches  con^letely  removes  the  constraints  inqxised  iqxm  wargaming  by 
higher  classification  data  Pertiaps  the  procedure  of  having  knowledgeable  pet^le  review  the 
results  is  bodi  the  most  ctmunon  a{^roach  to  this  problem  and  probably  the  least  satisfying. 
These  constraints,  however,  do  not  negate  the  value  of  waigaming  evoi  wlwn  higher 
classificatimi  data  must  be  ctmsktered. 

E.  Anticipated  Hardware  &  Software  Advances 

Tlw  Workshop’s  assessment  of  hardware  and  software  advances  over  die  next  tra  years,  alm^ 
widi  their  anticqiated  inqiact  on  waigaming,  is  summarized  by  Figure  2  and  discus^  at  length 
in  ^^lendix  E.  Strnie  of  these  advances  will  occur  with  or  without  special  oi^hasis  or 
support  from  wargaming  interests  within  DoD.  Other  advances,  especially  those  that  are 
impacted  by  the  aging  equipmmt  base  of  stnne  DoD  facilities,  may  be  stymied  without  special 
emjdiasis  and  support  from  DoD.  Identification  of  which  advances  belong  widiin  which  group 
was  beyond  the  scope  of  the  Worktop.  These  advances  will  make  it  easier  to  reduce  or 
remove  some  of  the  current  wargaming  limitations  and  obstacles  caused  by  hardware  and 
software  incon^atibilities  and  the  like,  especially  if  the  recommendations  of  the  May  1988 
Defense  Science  Board  Task  Force  on  "Computer  Applications  to  Training  and  Wargaming" 
are  implemented.  However,  this  wiU  place  more  iirpoitance  upon  fuller  development  of 
wargaming  theory  so  that  wargaming  iqiplications  will  not  be  concept  limited  unnecessarily. 


POTENTIAL  HARDWARE/SOFTWARE  ADVANCES 

(SC»IB  wax  OCCUR  WnHOUr  special  DOD  EPPORT;  OntHERS  REQUIRE  DOD  EMFHASIS/SUPPORT) 


TYPICAL  IMPROVEMENTS  AKnCIPATED 

OVER  NEXT  10  YEARS* 

IMPACT 

SSCTWaRE-^ 

•  CONCEPT  BASED  LANGUAGES 

•  SOFTWARE  ENGINEERING  ADVANCES 

•  ADAPTIVE  SYSIEMS 

REDUCE  WARGAMING  PREPARATION  * 

EXECUTION  RESOURCE  REQUIREMENTS; 

IMPROVEMENT  IN  PORTABILITY. 

PROCXtAM  MAINTENANCE,  ETC. 

KUIDWARE 

•  ORDER  OP  MAONITUDB  INCREASE  IN 

PROCESSOR  POWER 

•  SUBSTANTIAL  DECREASE  IN  EQUIPMENT 

SC^IRELATIVE  COST 

HUMAN/MACHINE  INTERFACES 

•  HKHI  RESOLUTION  IXSPLAYS 

•  VOICE  RECOONmON/PHYSIOLOOICAL 

DNEMATK  INTERFACES 

•  SELP-TAILORINQ  USER  INTERFACES 

WAROAMINO  APPUCATK»<S  BECOME  CONCEPT 

LE^fllED 

WHAT  LEVEL  OF  MODEL  nDOJTY  15  NBBDBD 

TO  SATBFY  A  GAME’S  OSJEdlVE  IF  IHBRB  ARB  NO 

siGNincAKT  comfotahonal  limtis  on  model 

lECHNIQUBr) 

coMM^NicIXTldRS  NEI'WOURS 

•  MAIOR  BANDWIDTH  INCREASES 
(■.f..  LOCAL  AND  COAST-TCVOOAST  flBBR 

OPIK  NBIWOMCS) 

PROLBERATTON  OF  IXSTRIBUTEO  WAROAMINO 

SYSTEMS 

ALSO  sm  RECENT  DSB  ’^(X^ARE  STUDY"  AND  MORS  WORKSHOP  ON  "SIMULATION  IBCHNOLOOY  199r 
ARTIFICIAL  INTELLKENCE  TOOLS  CAN  IMPROVE  WAR  GAMES.  BUT  SHOULD  NOT  REPLACE  KEY  HUMAN  PARTICIPATION 


Figure  2.  Potential  Hardware/Software  Advances. 
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In  addition,  a  research  and  development  program  to  attack  scnne  of  the  fundamental  difficulties 
of  wargaming  and  game  system  design  could  yield  enormous  dividends  by  establishing  a  more 
rigorous  foundation  for  wargaming  and  creating  some  of  the  basic  tools  needed  to  inqnove  the 
process.  Specifically,  the  community  should  fond  the  following  research  efforts: 

•  Develop  an  automated  war  game  design  aid  based  on  existing  expertise,  historical 
research,  and  careful  assessmmt  of  past  and  current  practices  and  dieory. 

•  Building  on  the  information,  insights,  and  expertise  developed  in  that  effort,  as  well 
as  existing  and  new  research,  develop  a  dieoretical  foundation  for  die  conqmtational 
aspects  of  wargammg. 

•  Based  on  such  a  theoretical  foundation,  develop  a  common  wargaming  language  that 
will  facilitate  the  integration  and  interfacing  of  a  large  fraction  of  existing  and  future  war 
games  without  major  rewriting  of  current  software. 

•  As  a  inroof  of  concept,  demonstrate  d^  feasibility  of  developing  a  wargaming  tool  kit 
to  assist  designers,  players,  and  analysts,  building  as  much  as  possible  on  those  systems, 
languages,  and  techniques  already  in  existence. 


Recommendations 

Wargaming  is  presently  used  in  ways  that  affect  technology,  acquisition,  and  TAB  decisions, 
but  its  use  in  these  domains  is  not  routine  in  the  sense  that  wargaming  is  not  a  regular  part 
of  the  decision  process.  It  should  be.  It  should  become  a  regular  part  of  the  normal  set  of 
analytic  processes  ai^lied  to  problems  in  all  of  these  domains  so  that  it  will  become  possible 
to  obtain  cumulative  benefits  from  multiple  games  as  well  as  the  insights  from  a  paitic^ar  war 
game.  In  addition  to  the  traditional  participation  in  war  games  by  operational  and  technical 
personnel,  analysts,  and  others,  senior  decision  makers  should  be  involved  in  some  war  games 
so  that  the  critical  issues  that  might  later  delay  and  hinder  program  prosecution  can  be 
id«itified,  clarified,  and  resolved  to  allow  expeditious  program  prosecution. 

A.  General  Recommendation: 

The  MORS  Sponsors  should  take  steps  to  encourage  and  facilitate  tqypropriate  and  routine 
use  of  wargaming  to  guide  technology,  acquisition,  and  T&E  decisions. 

This  recommendation  is  not  novel.  For  example,  a  June  1986  memo  from  VADM  J.  B.  Busey 
on  "Strategic  Planning  and  the  Technology  Base”  (ser  09/6U301083),  stimulated  by  a  report 
from  the  CNO  Executive  Panel  (CEP),  encouraged  use  of  wargaming  as  a  means  to  develop 
insights  about  allocation  of  R&D  resources.  Although  wargaming  has  been  used  beneficially 
on  numerous  occasions  as  in  the  Navy’s  Technology  Initiatives  Games  and  the  Army’s 
Technology  Base  Games,  it  has  not  yet  become  a  tegular  and  routine  part  of  the  technology, 
acquisition,  and  T&E  decision  process. 
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B.  Specific  Recommendations: 

1.  To  enhance  the  acquisition  process,  dw  Service  Senior  Acquisition  Executives 
should  draft  guidance  to  those  responsible  and  to  their  Program  Executive  Officers: 

•  Sensitizing  them  to  the  value  of  wargaming  in  the  acquisititm  process,  and 

•  Requesting  them  to  include  wargaming  as  a  key  tool  whoi  die  concqit  for  a 

program  is  being  developed. 

2.  To  enhance  the  T&E  process,  selected  representatives  from  OSD’s  and  the 
Services’  T&E  organizations  should  convene  a  short  woii^hq>  to  institutionalize  the  role  of 
wargaming  in  T&E. 

If  maximum  exploitation  of  new  or  improved  wargaming  ciqiabilities  made  possible  by 
hardware  and  software  advances  is  to  occur,  the  senior  decision  makers  in  wetqion  system 
acquisition,  USD(A)  and  the  Service  Acquisition  Executives,  must  become  involved  in 
waigaming.  As  the  May  1988  Defense  Science  Board  Task  Force  on  "Computer  Applications 
to  Training  and  Wargaming"  noted,  "in  an  era  of  shrinking  defense  funding,  an  investment  in 
improving  the  skid  of  the  senior  joint  decision-makers  exerts  enormous  leverage." 

In  the  OT&E  arena,  formal  guidance  about  use  of  simulation  and  models  exists  (Policy  for 
the  Application  of  Modeling  and  Simulation  in  Support  of  Operational  Test  and  Evaluation 
by  DOT&E,  dated  24  January  1989).  Similar  guidance  is  needed  for  use  of  wargaming  in 
T&E,  and  also  for  use  of  wargaming  relative  to  technology  and  acquisition  decisions.  This 
will  allow  more  of  the  potential  benefits  of  wargaming  to  be  realized. 
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APPENDIX  A 
WORKSHOP  OVERVIEW 


I.  WORKSHOP  STRUCTURE  AND  PROCEDURES 

The  Future  Wargaming  Develi^xnents  Woikshc^  had  six  main  parts:  four  topic  groups,  a 
Synthesis  Panel,  and  die  Qmtrol  Groiq>.  The  fmir  topic  groups  eadi  addressed  a  particular 
area  of  wargaming.  These  are  indicated  below.  The  Synthesis  Panel,  in  omjonctiQn  with  die 
Control  Group,  identified  areas  where  addhioiial  emidiasis  mi^  be  helpfiil  in  different  topic 
groiq». 

Topic  Groups: 

1)  Wargaming  and  Technology  Issues 

2)  Wargaming  and  Systems  Acquisition/Mai^wer  Planning 

3)  Wargaming  and  T&E/Operatioiial  Contexts 

4)  Hardware/Software  Technology  Advances  and  the  Wargaming  Impact 

There  were  plenary  sessions  each  morning  involving  all  Workshop  particqiants.  The  first  of 
these  provided  orientation  and  information  to  launch  the  Workshop.  The  next  two  of  diese 
allowed  the  four  topic  groups  to  present  dieir  findings  so  that  all  particqiants  could  share 
from  each  group’s  insights.  A  wnq>-up  plenary  session  was  held  at  the  end  of  the  Workshop. 
In  between  these  plenary  sessions,  the  groups  met  separately.  Figure  A>1  illustrates  the  way 
informatitm  flowed  during  the  Workshop  and  in  the  develqmrent  of  this  report. 


BMEnNOS 


Figure  A-1.  FWD  Process. 
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n.  WORK  GROUP  ASSIGNMENTS 

TaUe  A-1  lists  die  group  assignmaits  of  die  attendees. 

m.  WORKSHOP  ATTENDEES 

TaUe  A-2  is  a  coin|detB  name  and  address  listing  of  all  woiksht^  attendees. 

IV.  WORKSHOP  CHAIR'S  COMMENTS 

The  iqikl  changes  in  the  worid  situation  and  American  attitudes  toward  defense  have 
emphasured  die  potential  inqioftance  of  wargoning  to  help  develop  new  frames  of  reference 
within  whidi  to  address  future  DoD  issues.  Norman  Friedman  has  suggested  that  use  of 
wargaming  of  cridcal  defense  issues  to  broaden  appreciatitm  within  die  defense  establvdunent 
of  those  issues  may  be  essential  to  prevoit  or  to  minimize  untoward  changes  in  US  defense 
amiabilities  (Naval  fristitute  Proceedings.  Jan.  1990). 

The  Workshtmi  covered  a  lot  of  ground  and  produced  a  number  of  useful  insights.  These 
have  already  impacted  die  way  that  some  of  ^  Woiksh(m>’s  pardc^ants  have  fulfilled  their 
responsibilides  since  the  Workshop,  but  much  ronains  yet  to  be  dcm.  The  distincdve  and 
unique  potential  contribudons  of  wargaming  to  DoD  technology,  acquisidon,  and  T&E  decision 
processes  need  to  be  ardculated  better  and  communicated  more  convincingly  to  smior  decision 
makers.  Wargaming  theory  needs  to  be  developed  much  more  ctmqdetely.  At  present, 
wargaming  is  far  more  art  than  science.  Theoredcal  princ^les  have  yet  to  be  develtmied  duu 
(1)  define  condidons  which  allow  results  from  different  war  games  to  be  combined 
appropriately,  (2)  identify  the  impact  on  game  results  of  players  without  the  requisite  set  of 
skdis  and  attitudes,  or  (3)  indicate  what  levels  of  fidelity  in  models,  etc.,  is  required  by  a  war 
game’s  objectives. 

There  were  a  number  of  suggestions  from  participants  of  the  Workshop  about  how  senior 
DoD  decision  makers  should  be  involved  in  wargaming.  These  includ^  a  suggestion  that 
representatives  from  USD(A)/Service  Acquisition  Ezecutives;41-7/l-8  should  convene  to  develop 
broad  guidance  and  support  to  the  wargaming  commuiuty  by  formulating  policy  for  wargaming 
development,  serving  as  a  clearing  house  for  wargaming  models  and  data,  establishing  interface 
standards  to  facilitate  interacdois  among  wargaming  facilities,  etc.  It  was  even  suggested  that 
the  DoD  5000  series  documents  should  be  modified  to: 

•  include  wargaming  formally  in  the  acquisition  processes, 

•  cause  wargaming  to  be  used  tqipropriately  and  routinely  instead  of  occasionally  and 
^asmodically,  and 

•  ensure  tq^ropriate  involvement  of  decision  makers  in  wargaming  so  that  consensus 
about  program  need,  requirements,  and  future  ^stem  characteristics  can  be  obtairred 
in  a  timely  mamier  for  expeditious  program  prosecution. 
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V.  LESSONS  LEARNED  ABOUT  CONDUCTING  WORKSHOPS 


The  following  obseivati<nis  about  the  Woricshop  process  may  be  useful  for  those  who  coruhict 
future  Wodcshqps: 

•  The  subject  scope  of  this  Workshop  was  vary  large.  In  general,  a  more  narrow 
subject  is  ^ired  so  tfiat  a  workshop  can  produce  more  concrete  results.  However,  in 
this  case  there  existed  a  need  to  expose  the  corrununity  to  breadfo  of  potential 
wargaming  tqf^lications  and  to  get  the  community  to  start  thinking  more  in  this  mtire 
area. 

•  The  use  of  a  panel  of  senior  persoimel  (i.e.,  the  Synthesis  Panel)  to  help  working 
groups  of  die  Workshop  to  keep  perspective  and  to  think  bigger  worked  very  well  and 
caused  diis  Workshop  to  address  some  issues  (such  as  the  need  for  USE>(A)  to  be 
involved  in  wargaming)  that  it  otherwise  would  have  ignored. 

•  The  four  topic  groups  were  slighdy  larger  than  desired.  This  occurred  in  part  because 
there  were  very  few  people  registered  for  the  Workshop  who  did  not  attend.  Since 
commitments  to  invite  participants  must  be  made  weeks  before  a  workshop,  one  has  to 
guess  what  percentage  will  actually  attend.  If  too  few  are  invited  to  accommodate 
dropouts,  there  may  not  be  enough  people;  if  too  many  are  invited,  the  workshop  may 
have  too  many.  This  Worirshop  hni  2-4  excess  people  in  each  of  the  topic  groups. 

•  It  would  have  been  helpful  to  have  secretarial  help  for  each  of  the  topic  groups  so 
that  the  analysts  could  focus  on  the  conceptual  aspects  of  the  Workshop  instead  of 
having  to  devote  substantial  amounts  of  time  to  the  mechanical  aspects  of  producing 
briefoig  visuals  and  their  draft  reports.  Insistence  upon  draft  materials  before  workshop 
participants  leave  is  a  key  factor  in  producing  substantive  proceedings  from  a  workshop. 
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TABLE  A-1.  GROUP  ASSIGNMENTS. 


CONTROL 
AddiscMi,  Natalie 
Heidt,  CAPT  John 
Nortcm,  CDR  Jcrfm 
Pace,  I^.  Dale 
Potter,  Craig 
Wiles,  Richard 

ACQUISITION 
Dighton,  Robert 
Ebbert,  Edwin 
^>pers(m,  LTC  Lou 
Helmuth,  Richard 
Heimingsen,  Dr.  Jacqueline 
Hoffinan,  Robert 
niillips,  Scott 
Rich,  Qatk 
Smith,  LtCol  Bruce 
Thtmien,  LtCol  David 
Van  Nostrand,  Sally 

OT&E 

Clodiiers,  CAPT  Tom 
Eberth,  Robert 
Gatman,  Warren 
Hemingway,  MAJ  David 
Knize,  LCDR  Donald 
Lavoie,  Kenneth 
Lee,  LTC  David 
Ltmgo,  Dr.  Joseph 
Luhan,  CDR  John 
Minsk,  David 
Orcutt,  CDR  Bud 
Perrin,  Clifford 
Ritchie,  Dr.  Adelia 
Rogers,  Bruce 
Shukiar,  Herb 
Vickery,  COL  John 

OBSERVER 
Brady,  Edward 
Duim,  William 
Nolen,  LT  Tom 


SYNTHESIS  PANEL 
Gay,  Betty 
Hay,  O.E.  "Bud" 

Sariders,  Dr.  Patricia 
Schell,  Dr.  Allan 
Starr,  Dr.  Stuart 
Train,  ADM  Harry 
Vaughn,  R.S. 

HW/SW 
Bambery,  James 
Bouterie,  Larry 
Boyd,  LTC  David 
der  Boghossian,  Zaven 
Downes-Martin,  Dr.  Stefrfien 
Dunham,  LtCol  Alan 
Halwachs,  CDR  Thomas 
Herman,  Mark 
Hurley,  Chris 
Kirby,  C.L. 

Lema,  Jerry 
McIntyre,  Robert 
Peasant,  Janet 
Perla,  Dr.  Peter 
Seguin,  Paul 
Toohill,  Barbara 

TECHNOLOGY 
Butler,  CDR  Lonnie 
Carpemer,  Howard 
Dahmann,  Dr.  Judith 
Fox,  Dr.  Daniel 
Koten,  Marvin 
Lacetera,  JosejA 
Moses,  Dr.  Franklin 
Richardson,  CDR  Larry 
Schmidt,  LTC  Dennis 
Schriner,  Nina 
Stewart,  Joe 
Tino,  Marshall 
Tritten,  Dr.  James 
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TABLE  A-2.  WORKSHOP  PARTIOPANTS. 

(ADDRESS  AT  TIME  OF  WORKSHOP) 


Mt.  NattUe  S  Addiaoo 

Kfilitaiy  OpeMkas  Reaeaidi  Society 
101  S  Whklng  St 

Suile  202 

AkxandiU.  VA  22304-3813 

Mr.  James  Bambery 

Vector  Research,  Inc. 

901  S  HigUand  St 

Ailingtoa,  VA  22204 
703-521-5300 

Mr.  Larry  R  Bouterie 

12412  Bmges  Av 

Silver  Spring,  MD  20904 
301-731-9289 

LTC  David  G  Boyd 

The  Joint  Staff  (J8) 

PMSAD 

The  Pentagon 

Waahinfian,  DC  20318 

703-695-2020 

Mr.  Edward  C  Brady 

The  MITRE  Coq> 

7525  Colshiie  Dr 

MS  Z605 

McLean,  VA  22102 
703-883-6201 

CDR  Lonnie  Butler 

Naval  War  College 

Outer  for  Naval  Warfore  Studies 
Newport,  RI  02840 

401-841-2626 

Mr.  Howard  J  Caipeoter 

Potomac  Systems  Engineering 

7611  Little  River  Trim  Pike 

Snile  600 

Anmndale.  VA  22003 

703-642-1000 

CPT  Tom  aothieis 

Dr.  Judith  Dahmann 

The  MITRE  Ccrp 

7525  Colshire  Dr 

McLean,  VA  22102 

703-883-71% 

Mr.  Zaven  der  Boghossian 

CAQ.  Inc 

1600  ^Ison  BWd 

Snile  1300 

Arlington,  VA  22209 

703-875-2919 

Mr.  Robert  D  Dighton 

9332  SibeUos 

Vietma,  VA  22182 

Dr.  Stephen  Downes-Martin 

BBN  Systems  A  Tech  Corp 

10  Moulton  St 

Cambridge,  MA  02138 
617-873-3357 

LTC  Alan  D  Dunham 

darpahto 

1400  Wilson  Blvd 

Arlinglon,  VA  22209 

703-694-5738 

Mr.  William  Dunn 

MISMA 

1900  Half  St 

Room  LlOl 

Washington,  DC  20324 
202-475-2951 

Mr.  Edwin  L  Ebbert 

Johns  Hopkins  University/APL 
NWAD,  NCE  GROUP 

Johns  Hofdrins  Rd 

Laurel,  MD  20707 

301-953-5622 

Mr.  Robert  W  Eberth 

Advanced  Tedmology,  Inc 

Suite  200,  MS  n  CP  -  2.07 

Two  Crystal  Park,  2121  Crystal  Dr 
Arlington,  VA  22202 

703-769-3105 

Dr.  Daniel  B  Fox 

The  Rand  Coip 

2100  M  St,  NW 

Washington,  DC  20037-1270 
703-296-5000 

Mr.  Wanen  W  German 

The  MITRE  Corp 

Box  9013 

Hurlburt  Field,  FL  32544 
904-581-1685 

Mrs.  Betty  Gay 

Naval  War  (^dlege 

Onter  for  Naval  Warfare  Studies 
Newport,  RI  02840 

401-841-2138 

CDR  Thomas  E  Halwachs 
Naval  Postgraduate  School 
Code  55Ha 

Monterey,  CA  W943-5100 
408-646-2413 

LCDR  Randall  W  Hamilton 
OCNO  (OP-816N) 

Department  of  die  Navy 
Washington,  DC  20350 
703-6959440 

Mr.  OJB.  "Bod"  Hay 

Naval  War  (College 

Center  for  Naval  Warfoie  Studies 
Newport,  RI  02841-5010 
401-841-3306 

CAPT  John  H  Heidt 

Naval  Wargaming  Center 
Newport,  RI  02841 
401-841-2101 

Mr.  Richard  E  Helmuth 

Douglas  Aircraft  Co 

Mail  Code  35-95 

3855  Lakewood  Blvd 

Long  Beach,  CA  90846 
213-593-7241 
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MAJ  David  F  Hemingway 
371  Bonier  Rd 
Port  bum.  TX  79906-3807 
91S-S68-1238 


Mr.  Robert  B  Hofitaian 
1320  Avmiida  Lome  Viati 
Sea  Dimae,  CA  91773 
714-868-4293 


LCDR  Dooidd  Knize 

Nevel  War  College 

Center  For  Naval  Waifiue  Studies 

Newport,  RI  02840 

401-841-2626 

Mr.  Kenneth  E  Lavoie 
AUCADRE/WGT 
Building  1406 

MaxweU  AFB,  AL  36112-SS32 
20S-293-6S28 


Dr.  Josq>h  P  Longo  Jr 
Defense  Intelligenoe  Agency 
Defense  Intelligence  Ctrilege 
DIA/DIC-4,  Attn:  Dr.  Longo 
Washingtan.  DC  20340-S48S 
703-373-4234 

Mr.  David  A  Minsk 
FMC 

Naval  Systems  Div,  MS  T-lOO 
4800  East  River  Rd 
Minneapolis.  MN  SS421 
612-337-3119 

CDR  Jolm  Nmton 

Naval  War  College 

Center  Naval  Warfeie  Studies 

Newport.  RI  02840 

401-841-3346 


hfe.  Janet  Peasant 
AF  Human  Resources  Lab 
Ground  Ops  Branch 
AFHRL/LRO 

Wiight-Patteison  AFB.  OH  45433 
513-255-9946 


Dr.  Jacqueline  Henningaen 
HQ  SAC/NRO 
Sdenoe  and  Research 
Ofiuu  AFB.  NE  68113-5001 
402-294-2355 

Mr.  Christopher  M  Hurley 
Jdms  Hopi^  Univ/APL 
Johns  Hopkins  Rd 
Laurel.  MD  20707 
301-953-6490 

Mr.  Marvin  Koren 

USA  CECOM 

Atm:  AMSEL.RD-ASC 

Port  Monmoudt.  NJ  07703-5000 

201-532-0014 

LTC  David  B  Lee 
Air  Force  Wargaming  Center 
AUCADRE/WGT 
Building  1^ 

MaxweU  AFB.  AL  36112-5532 
205-293-6528 


Dr.  Fhmklin  Moses 
USA  Research  Institute 
5001  Eisenhower  Ave 
Atm:  PERI-IP 
Alexandria.  VA  22333 
703-274-8816 


Mr.  Mark  Hetnun 
Booz.  AUen  &  Hamilton.  Inc 
1725  Jefferson  Davis  Hwy.  #1100 
Arlington.  VA  22202 


Mr.  C  L  Kirby 

USA  TRADOC  Aiudysis  Command 
Atm:  ATRC-RD 

White  Sands  Missile  Range,  NM 
505-678-5911 

Mr.  Josqd)  Laoetera 
US  Army  Laboratory  Command 
2800  Powder  MiU  Rd 
Adelphi.  MD  20783-1145 
301-394-4650 

Mr.  Jerry  Lema 
Naval  War  College 
Wargaming  Dept 
Newport.  RI  02841 
401-841-2626 


LT  Tom  Nolen 
OCNO  (OP.814E1) 
Department  of  the  Navy 
The  Penugon 
Washington,  DC  20350 
703-697-5636 


CDR  Bud  Orcutt 
Naval  War  College 


Dr.  Dale  K  Pace 

Johns  Hopkins  University/APL 


Center  for  Naval  Warfare  Studies  Naval  Warfare  Analysis  Dept 


Newport,  RI  02840 
401-841-2626 


Johns  Hoiddns  Rd 
Laurel.  MD  20707-6099 
301-953-5650 


Dr.  Peter  P  Peria  ID 
Center  for  Naval  Analysis 
4401  Ford  Ave 
PO  Box  16268 
Alexandria,  VA  22302-0268 
703-824-2357 


Mr.  CliCFotd  S  Perrin 
McDotmeU  Douglas 
Suite  550 
1550  Wilson  Blvd 
Ariington,  VA  22209 
703-276-4624 


CDR  John  Lnhan 
Naval  War  College 


Mr.  Robert  T  Mdntyte 
Simulation  Technologies  Inc 


Center  for  Naval  Warfare  Studies  111  West  Rrst  St,  Suite  748 


Newport,  RI  02840 
401-841-2626 


Dayton.  OH  45402-1106 
513-461-4606 
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Mr.  Soott  pyOiiM 

USAMSAA 

Ann:  AMXSY-A 

Abetdeen  PO.  MD  21005 
301.278-6366 

Mr.  Craig  D  P(»ter 

Simulation  Technologies  Inc 

111  West  First  St 

Suite  748 

Dayton,  OH  45402 

513-461-4606 

Mr.  Qark  Rich 

Frontier  Techncdogy  Iik 

Progrun  Manager 

530  E  Montedto  St,  #105 

Santa  Barbara,  CA  93103-3245 
805-965-2477 

CDR  Laity  Richaidsoo 

Naval  War  Qdkge 

Watgaming  Dept 

Ner*]^  RI  02841 

401-841-2626 

Dr.  Adelia  E  Ritchie 

9735  Clailxnne  Square 

La  Jolla,  CA  92037 
619-546-6564 

Mr.  Bruce  F  Rogers 

1212  Dale  Dr 

Silver  S|ning,  MD  20910 
703-642-1000 

Dr.  Patricia  A  Sanders 

OSD/DOT&E 

Tbe  Pentagon,  Room  1C730 
Washington,  DC  20901-1700 
703-697-3125 

Dr.  Allan  C  Schell 

AFSC/CA 

Chief  Scientist 

Andrews  AFB,  DC  20334-5000 
202-981-4215 

LTC  Dennis  Schmidt 

9309  Mainsail  Dr 

Burke,  VA  22015 

301-394-3015 

Ms.  Nita  Schriner 

Naval  Weapon  Center 

Code  3081 

China  Lake,  CA  93355 

Mr.  Paul  B  Seguin 

Engineer  Studies  Center 

Casey  Building 

Fort  Belvoir,  VA  22060 
703-355-2113 

Mr.  Herbert  J  Shukiar 

The  Rand  Corp 

1700  Main  St 

Santa  Monica,  CA  90406-2138 
213-393-0411 

LtC(d  Bmoe  L  Smith 

AF/SAZ 

The  Pentagon.  Room  1D377 
Washington,  DC  20330-5420 
703-697-0862 

Dr.  Stuart  Starr 

The  MTTRE  Corp 

Director  of  Plans,  MS  Z661 

7525  Coldiire  Dr 

McUan.  VA  22102 
703-883-5494 

Mr.  Joseim  S  Stewart 

7105  Falcon  Dr 

Plano,  TX  75025 

214-575-5642 

LtCol  David  S  Thomen 

MC  Wargaming  &  Assessment  Ctr 
MCCDC 

Qnantico,  VA  22134 

703-640-3276 

Mr.  Marshall  J  Tino 

Naval  Surface  Weapons  Center 
Protection  Systems  Div 

Code  H 

McLean.  VA  22448 
703-663-8771 

Ms.  Barbara  G  Toohill 

The  MITRE  Corp 

MS  W410 

7525  Colshire  Dr 

McLean,  VA  22102 

703-883-6454 

ADM  Harry  D  Train,  USN  Ret 

SAIC 

100  W  Plume  St 

Suite  300 

Norfolk,  VA  23510 

804-623-2336 

Dr.  James  J  Trittcn 

Naval  Postgraduate  School 
National  Security  Affairs  Dep. 
Code  56rr 

Monterey,  CA  93$>43-5100 
408-646-2143 

Ms.  SaUy  J  Van  Nostrand 

HQ  US  Army  Laboratory  Command 
Atm:  AMCLD-PA 

2800  Powder  MiU  Rd 

Adelphi,  MD  20783-1145 
301-394-4650 

Mr.  R  S  Vau^ 

OCNO  (OP-987C) 

Department  of  the  Navy 

Washington.  DC  20350-2000 

COL  John  Vidaery 

Air  War  College 

Atm:  DFX 

MaxweU  AFB.  AL  36112 
205-293-2305 

Mr.  Richard  I  V^les 

203  Yoakum  Padcway 

Apartment  1009 

Alexandria,  VA  22304 
703-751-7290 
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APPENDIX  B 

TECHNOLOGY  ISSUES  GROUP  REPORT 


I.  INTOODUCnON  TO  WARGAMING  AND  TECHNOLOGY  ISSUES 
A.  Definidons  and  Background. 

TIG89  was  played  at  the  Naval  War  College  16-21  July  1989.  Ln  addition  to  its  basic  puipose 
as  a  war  game,  it  had  the  additicmal  objective  of  refining  technology  gamiitg.  To  this  latter 
task  was  assigned  a  six-member  Methodology  Cell.  This  group  was  to  develop  a  dieoietical 
firamewoik  for  TlG-like  activities,  suggest  a  Plan  Of  Action  &  Milestones  (POAM)  for  TIG-90, 
and  prq>aie  a  handbook  for  conducting  future  HG-like  activities.  It  was  also  antici^ed  that 
the  Methodology  Cell  Report  would  provide  a  basis  for  fiirfoer  development  of  technology 
gaming  methodology  in  the  MORS  Future  Wargaming  Developments  Woricshop,  and  it  was 
expected  dut  dw  ideas  resulting  from  the  Workshop  about  technology  gaming  would  be  further 
disseminated  among  the  analysis,  gaming,  and  technology  communities  throughout  the  defense 
community  after  the  Workshop.  Among  die  contributions  of  the  TIG-89  Methodology  Cell 
Report  are  a  framework  for  technology  gaming  which  includes  a  list  of  seven  game 
characteristics  for  which  technology  gaming  is  useful,  and  a  model  "System  Engineering" 
Process  which  emphasizes  TIG’s  role  as  an  exercise  which  raises,  refines,  and  channels  issues. 
The  report  discusses  technology  representation,  system  and  operational  concepts,  scenarios, 
game  participants,  game  products,  and  follow-up  actions  in  preparation  for  odier  games.  The 
POAM  for  TIG-SK)  and  the  TIG  handbook  provide  excellent  guidance  for  future  wargaming. 

For  the  purposes  of  this  report,  we  define  wargaming  as  any  form  of  research,  analysis, 
training,  education,  or  recreation,  that  is  intended  to  produce  better  understanding  of  warfare, 
which  involves  people  direcdy  in  the  con^utation/gaming  process.  This  definition  excludes 
con^uter  simulation  or  closed-form  mathematical  analysis  which  does  not  involve  a  human 
dire^y  in  the  computation  process.  However,  such  methods  of  analysis  may  be  used  in 
support  of  war  games  and,  we  accept,  as  a  ^cial  case  of  wargaming,  computer  simulations 
for  which  the  human  decision-making  process  is  represented  by  some  form  of  Al. 

The  role  of  war  games  in  military  forecasting  is  best  defined  in  terms  of  what  is  hoped  to  be 
accomplished  by  a  particular  game  (or  form  of  game)  and  how  this  compares  with  other 
methods  of  analysis  that  might  be  used  to  accomplish  the  same  things.  Technology  wargaming 
(TWG)  has  a  basic  goal  of  focusing  the  teclmology  base  investment  strategy  (TBIS)  and 
providing  a  rationale  for  its  resource  allocation.  Ideally,  TWG  will  provide  a  means  of 
selecting  technologies  for  development  that  will  produce  those  systems  that  will  meet  our 
ftiture  warfighting  requirements.  It  can  do  this  by  providing  insights  into  the  effectiveness  and 
military  utility  of  conceptual  systems  which  embody  emerging  technologies.  TWG  also  serves 
to:  e^cate  techbase  managers  on  the  relationship  between  technology,  strategy,  tactics,  and 
scenarios;  and  expose  militaiy  personnel  to  the  potential  of  advanced  technology.  TWG  is 
part  of  a  spectrum  of  gaming  tools  which  are  available  to  the  RDA  community,  and  in  fact 
is  a  driver  for  higher  resolution  war  games,  manned  simulator  games,  battle  simulations,  and 
more  traditional  analysis  such  as  closed-form  few-on-few  battle  simulations. 
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The  tech  base  includes  basic  research  (6.1),  exploratory  development  (6.2),  and  advanced 
non-system  development  (6.3a).  6.3a  work  shows  up  in  fielded  systems  in  5-15  years,  6.2 
work  is  manifested  in  systems  iq>pearing  in  10-30  years,  and  6.1  work  in  ^sterns  qipearing 
in  20-50  years.  Among  the  various  analysis  methods  in  analyzing  systems  in  these  time 
frames  are  trend  extrqwlation  which  is  commonly  used  for  un^rstanding  technology  in  the 
5-15  year  time  frame,  and  scenario  writing  which  is  generally  applied  to  technologies  that 
will  be  represented  in  the  systems  of  15  or  more  years  in  die  future.  Trmd  extrqiolatimi  is 
not  particularly  a{^licable  to  evaluation  of  conceptual  systems  representing  emerging 
technologies.  Most  qiplicable  to  the  class  of  problems  encountered  in  analyzing  conceptual 
systems,  and  thereby  emerging  technologies,  is  TWG,  which  in  effect  relies  on  the  expert 
wisdom  of  the  best  available  scientists  and  technologists.  Seminar  Wargatning  (SWG) 
accomplishes  this  in  a  strict  seminar  format,  and  in  a  sense  is  the  purest  form  of  TWG.  Here, 
spontaneous  decisions  are  made  by  human  players  as  opposed  to  die  case  of  ctmventional 
batdefield  simulations  which  are  usually  non-interactive  and  highly  deterministic.  A  similar, 
but  somewhat  more  quantitative,  approach  is  the  computer  su|^rted  seminar  war  game 
(CSSG)  which  also  uses  expert  opinion,  but  supports  the  seminar  process  with  a  conqiuter 
model  of  the  systems  and  operations.  In  such  a  game,  the  computer  process  is  interactive 
with  decisions  being  made  by  human  players  as  opposed  to  the  case  of  conventional  batdefield 
simulations  where  the  decision  process  is  represented  by  models  and  databases. 

SWG  has  particular  applicability  to  problems  that  are  not  well  enough  defined  to  be  amenable 
to  solution  in  closed  form,  and  in  fact,  because  of  its  open  format  is  better  suited  to 
illuminating  such  problems  than  more  quantitative  forms  of  analysis.  It  is  a  primary  step 
toward  making  the  assessment  of  conceptual  we^n  systems  amenable  to  more  tradition^ 
analysis,  and  is  the  driver  of  these  other  forms  of  analysis.  As  such,  SWG  is  on  one  end  of 
a  spectrum  which  includes  higher  resolution  games,  maiuied  simulator  games,  and  closed-form 
simulations.  TWG  has  to  be  supported  by  intellectual  efforts  to  define  the  conceptual  systems. 
This  includes  the  determination  of  how  emerging  technologies  can  be  incorporated  into 
conceptual  systems,  how  these  systems  will  be  employed,  and  what  system  specifications  will 
make  them  relevant  to  future  battlefield  requirements.  The  game  itself  wiU  then  determine 
what  performance  parameters  weigh  heavily  upon  the  outcome  of  an  action  and  what 
technologies  contributed  to  that  outcome. 

To  place  TWG  among  more  traditional  forms  of  analysis,  we  should  look  at  what  its  operators, 
operands,  and  products  are  as  opposed  to  what  they  are  in  closed-form  analysis  (CFA).  The 
operators  for  TWG  are  the  players  and  the  game  rules,  while,  at  the  other  end  of  the 
spectrum,  in  CFA  they  are  tire  closed-form  trKxiels.  The  operands  of  TWG  are  the  conceptual 
systems  and  scenarios  to  be  evaluated,  while  in  CFA  the  operands  are  well  defined  system 
descr^tions.  The  products  of  TWG  are  the  projected  battlefield  utilities  of  conceptual  systems 
and  the  emerging  technologies  they  represent,  while  for  CFA  they  are  the  predicted  batdefield 
utilities  of  next-generation  systems.  These  two  methods  are  at  opposite  ends  of  the  spectrum 
and  are  tq^licable  to  different  classes  of  problems.  Each  is  more  credible  than  the  other  when 
iqiplied  to  the  qrpropriate  problems. 
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B.  Value  of  Technology  War  Games. 

Waxgaming  has  the  advantage  of  being  extremely  adq>table;  having  the  ability  to  OHnbine 
aspects  of  a  number  of  other  imthodologies  (therefore  minimizing  the  drawbacks  of  a  single 
m^od)  and  able  to  be  tailored  to  specific  objectives  or  environments.  War  games  can  force 
the  particq)ant  to  deal  with  the  comprehensive  effects  of  decisions  and  mult^le  pittfas  that 
events  might  take.  Depending  upon  the  participants,  a  war  game  can  be  an  extremely  creative 
oivirtMiment  widi  great  potential  to  br^  beyond  normal  modes  of  t’  ring.  Since  they 
eventually  resuh  in  a  verbal  descrh>tion  of  tteir  results,  dieir  outputs  are  reastmably  user 
friendly  and  likely  to  be  comprehended. 

The  most  important  determinant  of  the  war  game  is  the  purpose  for  which  it  will  be  used. 
The  purpose  of  the  war  game  will  be  influenced  by  and  in  turn  influence  a  number  of  odier 
factors  such  as  available  time  for  die  game,  the  game’s  physical  location,  the  scenario/game 
time,  the  game’s  sponsors,  and  player/partic^ants.  These  additional  factors  will  be  discussed 
later.  At  this  point,  three  major  purposes  for  technology  waxgaming  (research,  consensus 
building,  education)  will  be  considered  to  better  understand  why  technology  wargaming  should 
be  performed  in  the  first  place. 

1.  Research.  Supporters  of  technology  wargaming  argue  that  such  games  might 
be  able  to:  (1)  assist  decision  makers  in  the  setting  of  investment  strategies  and  acquisition 
policies,  and  (2)  provide  insights  about  the  milhaxy  utility  of  technologies  and  new  weapons 
systems.  Obviously,  there  are  other  techniques  that  can  also  provide  such  decision  making 
assistance  and  insights.  There  are,  however,  some  things  that  technology  war  games  can 
provide  that  might  be  mote  successful  than  other  methods. 

Games  and  simulations  can  be  conducted  for  the  purpose  of  technology  forecasting. 
Forecasting  emerging  technologies  that  have  some  value  are  important  in  helping  decision 
makers  to  select  technologies  for  future  development  thus  providing  a  ratioiude  for  their 
resource  allocation  decisions.  Good  forecasts  would  also  be  instrumental  in  facilitating  the 
creation  of  an  investment  strategy. 

A  technology  war  game  can  be  sponsored  for  the  purpose  of  stimulating  participants  who  are 
well-experienced  in  some  specific  area  to  think  creatively  about  a  subject  that  they  had  thought 
was  previously  "mined  out."  A  freewheeling  seminar  game,  whose  scenario  allows  flexibility, 
might  be  just  the  vehicle  to  create  interaction  between  a  group  of  technical  experts  and 
operators. 

A  major  problem  in  gaming  current  and  future  enviromnents  is  the  player  who  feels  that  he 
has  to  represent  organizational  interests.  A  shared  topic  of  interest  can  generally  be  openly 
discussed  by  a  group  of  experts  using  a  non-threatening  seminar  environment  by  offering  no 
identification  of  the  affiliations  of  the  panicipants,  by  not  using  titles  or  ranks  (or  wearing  of 
uniforms),  by  mixing  in  govenunent  and  non-government  participants,  and  by  frequently 
reminding  the  participants  that  "after  all,  this  is  just  a  ’game’." 

The  results  of  such  interactions,  when  flee  thought  is  encouraged,  might  well  exceed  that 
produced  by  more  traditional  methods.  As  an  example,  a  group  of  individuals  who  have 
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already  written  numerous  articles  and  books  on  a  subject  or  worked  in  a  field  for  many  years 
and  inigjit  find  that  they  stimulate  others  and  in  turn  are  stimulated  by  tibe  interacticms  of  a 
game  designed  to  oqdore  their  primary  area  of  expertise.  They  might  find  that  offering 
mm-tradittonal  optimis  in  a  gaming  environment  is  more  acceptable  dum  by  {uesenting  than 
at  a  formal  conference. 

Obviously,  scenarios  must  be  flexible  for  such  freewheeling  exercises  and  may  have  to  be 
totally  rewritten  during  a  game  to  support  the  path  that  patticq>ants  desire  to  go  in  order  to 
{MTOperly  address  an  issue.  Freewheeling  games  place  demands  on  game  control  teams  that 
cannot  be  met  by  the  average  person. 

Path  gaming  is  a  new  type  of  seminar  style  game  that  has  recently  been  used  in  die 
Washington  environment.  Path  games  present  special  challenges  for  scenarios.  Rather  than 
being  a  simulation  or  game  of  a  specific  event,  the  seminar  is  used  to  explore  alternative 
futures  and  to  identify  key  decisions  that  would  have  to  be  made  or  roadbloclb  to  that  future. 

One  type  of  path  game  will  pick  a  specific  alternative  future,  say  one  in  which  the  laboratories 
have  offered  up  a  new  technological  opportunity,  such  as  space-based  strategic  defenses,  and 
the  game  would  be  to  play  out  the  actions  that  would  need  to  be  taken  by  the  military  and 
political  communities  to  field  such  a  system.  Another  path  game  might  be  if  the  military  has 
been  told  to  divest  itself  of  forces  and  hardware  -  not  acquire  new  material.  The  game  would 
be  to  go  from  die  present  time  and  move  along  one  or  many  paths  to  that  goal. 

Other  types  of  path  games  move  from  the  present  to  an  unspecified  future  along  whatever  path 
die  participants  desire  to  explore.  This  type  of  path  game  might  be  of  interest  to  the 
technological  community  to  explore  possible  courses  of  action  and  strategies  for  investment 
in  basic  research.  This  type  of  path  game  is  the  most  challenging  for  the  scenario  writer  since 
major  portions  of  the  scenario  literally  is  made  up  during  the  game  itself.  This  degree  of 
flexibility  calls  for  the  use  of  scenario  writers  with  considerable  experience  and  special  skills. 

To  get  a  group  to  consider  extremely  complicated  issues  in  war  games,  the  transition  to  a 
defense  dominant  world  allowed  by  new  technologies  being  a  good  example,  the  scenario 
required  might  be  one  that  is  cr^able  of  knocking  the  legs  out  from  under  the  players.  Using 
that  case,  rather  than  have  a  scenario  created  out  of  the  more  customary  cases  of  future  wars 
used  in  the  programming  and  budgeting  cycle,  a  totally  unexpected  but  intriguing  scenario 
might  be  the  more  appropriate  vehicle  to  cause  participants  to  focus  on  the  major  issue  rather 
than  how  to  fight  or  prevent  the  war  that  they  "normally"  considered  (or  dieir  organization  has 
a  stake  in)  in  the  first  place. 

Gaines  and  simulations  may  in  fact  be  a  major  input  to  follow-on  analysis  conducted  for 
very  specific  purposes.  In  such  cases,  the  scenario  and  game  play  is  constrained  by  the 
requirement  to  support  the  follow-on  analysis.  Thus  while  in  some  cases,  it  is  entirely 
appropriate  (and  may  even  be  necessary)  to  rewrite  a  scenario  during  a  "creative"  exploration 
simulation  or  game  used  for  research,  other  types  of  games  may  have  to  rigidly  follow  the 
"scr^"  in  order  to  stick  to  the  issues  that  will  be  addressed  during  follow-on  hard  analysis. 
Obviously  selection  of  players  can  be  crucial  to  the  feasibility  of  conducting  either  type  game. 


Many  smmlations  and  games  are  designed  to  explore  strategy/fotce  mismatches.  One  major 
option  for  sudi  exercises  is  to  hold  a  desired  scmario  ai^  dien  manipulate  technologies 
availaUe  or  die  force  structure,  exploring  the  impact  of  varying  possible  futures  on  the  ability 
to  attain  goals.  Another  option  is  to  vary  the  technological  assumptions  and  dieiefore  die 
dueat  posed  by  a  competitor  and  vary  own  technologies  and  force  stracture  needed  to  te^xxid 
to  attain  desired  goals.  Generally,  programming  is  well  served  by  scoiarios  diat,  for  exan^le, 
manipulate  or  qieculate  on  technologies  and  forces  available. 

Alternatively,  forces  can  be  held  constant,  and  the  scenario  or  strategy  varied,  exploring  the 
possibilities  of  new  operatioiud  employment.  Holding  force  stracture  craistant  can  be  very 
helpful  in  illuminating  war  and  campaign  planning,  i.e.,  better  methods  of  ccmducting  near-term 
campaigns  with  existing  forces  already  on  hand.  War  games  can  allow  nations  to  test  new 
doctrines,  omcepts  of  operations,  strategies,  operations,  tactics,  or  alternative  force  postures. 
Each  type  of  exercise  (programming  or  war  planning)  requires  vasdy  differait  types  of 
supporting  scenarios. 

Programming  and  war  plarming  games  both  treed  to  account  for  the  differences  between 
declaratory  policies,  doctrine,  and  strategies  and  actual  strategies  and  plans  which  would  be 
executed.  Although  forces  tend  to  fight  like  they  train,  the  actions  nations  threaten  in  order 
to  suj^rt  deterrence,  are  not  necessarily  the  ones  that  nations  governed  by  real  pet^le  will 
take  when  events  actually  unfold.  An  examination  of  a  future  campaign  or  war  bas^  upon 
declaratory  strategies,  etc.,  might  look  significantly  different  than  if  such  an  examination  were 
based  upon  actual  plans.  Obviously,  actual  plans  and  ctqrabilities  of  own  forces  are  carefully 
guarded  secrets,  hence  the  pool  of  potential  players  for  a  game  based  upon  actual  war  plans 
might  be  totally  different  than  those  used  in  a  programming  game.  This,  in  turn,  wUl  have 
an  influence  on  the  type  of  scenario  gamed. 

Technology  gaming  would,  by  its  very  nature,  tend  to  deal  with  declaratory  strategies  used  in 
support  of  programming  rather  than  to  need  access  to  real  war  plans.  Once  a  group  of 
technology  gamers  has  been  created,  they  might  be  used  to  explore  the  range  of  options 
available  to  war  plarmers  even  if  war  planners  might  not  contribute  to  the  scenario  being 
gamed. 

New  techniques  of  artificial  intelligence-like  systems  (expert  judgment  to  represent  human 
players)  offer  us  the  opportunity  to  explore  wider  ranges  of  alternative  futures  than  have  ever 
bem  possible  before.'  Some  have  even  argued  that  such  systems  offer  the  possibility  of 
generating  scenarios  for  games.^  With  the  speed  available  in  these  new  techniques,  instead 
of  rurming  one  or  even  a  handful  of  games  and  simulations  each  year,  modem  simulations 
centers  will  be  able  to  run  literally  hundreds  of  alternate  cases  in  a  reasonably  short  order. 

By  manipulating  one  or  a  few  variables  and  holding  the  rest  constant,  analyst  may  be  better 
able  to  perform  sensitivity  and  contingency  analysis  using  these  modem  con^uter  games  like 
they  have  never  been  able  to  do  in  manual  games.  A  suj^rting  system  such  as  diis,  if  it 
were  in  support  of  a  large  manpower  intensive  game  such  as  Global  at  the  Naval  War  College, 
could  be  used  by  the  Control  team  to  "game  the  game"  and  create  well-designed  scenarios, 
to  siqrport  decision  making  during  the  game,  and  to  perform  post-game  analytical  exploration 
of  paths  that  were  not  taken  by  players  during  the  human  game. 
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Scenarios  used  to  support  research  must  be  feasible,  but  not  necessarily  credible.  To  supprm 
research,  an  incredihle  scenario  might  even  be  preferred.  Where  incrediUe  scenarios  are  utwd. 
Ctmtrol  teams  must  ensure  that  qipropriate  disclaimers  are  used  or  classification  protects  the 
sensitivity  of  die  ctmcqits. 

In  the  late  1960s  and  early  1970s,  Royal  Ehitch/Shell  used  a  technique  of  "scoiario  planning" 
whidi  included  some  incr^ble  alternative  futures  in  order  to  prqiare  dieir  business  for  a  wide 
variety  of  futures.’  One  of  the  results  of  this  effort  was  that  Shdl’s  management  was  better 
prqiared  for  the  unexpected  1973  oil  crisis.  Shell's  scenario  planning  forced  managers  to  deal 
with  uncertainty  and  diereby  understand  and  andcqiate  risk.  It  also  helped  them  discover 
strategic  optkms  that  they  were  not  seriously  aware  of.  Such  an  exercise  afforded  Shell  die 
tqiportunity  to  gain  a  conqietitive  advantage.  With  the  widely  changing  events  of  die  world 
during  1989,  perluqis  it  is  time  to  explore  similar  incredible  futures. 

Ccmqietitive  strategies  are  only  recendy  beginning  to  gain  acceptance  within  the  Pentagon. 
Gaming  is  a  very  useful  methodology  to  explore  competitive  strategies.  By  forcing  players 
to  ctHisider  outputs  and  by  tying  military  outputs  to  objectives,  the  player  is  confftmted  the 
need  to  defim  (or  demiuid)  explicit  goals.  He  is  further  introduced  to  the  concept  of 
international  conqietition  before,  during,  and  after  the  armed  conflict.  The  United  Sttttes  has 
finally  come  about  and  recognized  that  in  "peacetime"  we  are  engaged  in  a  long-term 
c<»npetitive  relationship  with  Japan,  the  Soviet  Union,  and  other  nations.* 

There  is  no  reason  to  not  engage  in  creative  scenario  planning  and  foUow-on  gaming  for  the 
United  States  to  understand  die  foil  range  of  technological  threats  that  might  be  posed  by  the 
npidly  changing  world  around  us.  There  is  also  no  reason  for  government  to  do  technology 
games  without  die  foil  participation  of  industry  and  the  vast  resources  that  they  can  bring  to 
bear.  Involving  industry  will  require  consideration  of  how  to  handle  private  "proprietary" 
information  much  d»  same  as  government  will  have  to  wresde  with  shiuing  its  intelligence 
data  and  methods. 

2.  Consensus  Building.  Another  use  of  scenarios  and  war  games  is  to  create 
perceptions  and  build  consensus.  For  example,  if  (1)  the  Politburo  reads  in  the  Western  open 
literature  that  NATO  commanders  say  that  due  to  incomplete  funding  for  conventional  defense, 
NATO  will  have  to  resort  to  early  use  of  nuclear  wepons  in  self-defense,  and  (2)  the  Soviets 
perceive  that  there  are  nuclear  weapons  in  Europe,  and  (3)  the  Warsaw  Pact  military  reports 
that  there  are  fiequent  exercises  by  NATO  whose  scenarios  demonstrate  that  they  are  clearly 
designed  to  practice  the  early  release  of  such  weapons,  then  the  Polidniro  would  be  justified 
in  teaching  the  conclusion  if  they  break  the  peace,  they  risk  nuclear  war  fighting.  In  such  an 
environment,  to  exercise  (or  simulate  or  game)  without  a  scenario  that  lends  support  to  the 
perception  intended,  would  be  to  undermine  deterrence! 

If  die  United  States  were  to  invest  in  new  technologies  that  would  result  in  new  forces,  it 
would  have  to  parallel  such  investment  with  an  explicit  conunutucation  of  capability  in  the 
form  of  exercises,  games,  and  public  scenarios  used  to  exploit  those  new  technologies.  To 
not  follow-up  witii  these  efforts  would  be  to  not  conununicate  a  tiireat  and  therefore  to  not 
serve  the  purposes  of  deterrence. 
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Soenarios  «id  war  gam^  offer  the  opportunity  for  marketing  ideas  and  consorsus  building. 
For  examine,  if  a  simulation  or  game  was  sponsored  by  an  organization  that  was  attempting 
to  maiket  an  idea  ot  a  product,  one  should  not  be  surprised  to  find  scenarios  and  games  that 
supported  that  idea  or  product.  The  ethics  of  ruruiing  such  otercises  are  no  more  complicated 
than  the  etiucs  of  creating  a  motitm  picture,  study,  or  book  that  has  an  undnlying  message 
of  "sales."* 

Since  it  qipears  tiiat  there  is  a  type  of  individual  that  is  more  likely  to  receive  messages  if 
they  are  fourxl  in  simulations  and  games  (just  as  there  ate  those  who  ate  equally  turned  off), 
thor  by  holding  a  series  of  stractured  exercises  with  prepackaged  scenarios  and  strtmg  controls, 
it  is  l^ly  that  a  significant  number  of  key  irulivi^als  could  be  influoiced  to  die  point  diat 
a  consensus  could  be  built. 

As  a  program  enters  the  development  stage,  war  games  can  be  used  as  a  device  to  both 
educate  the  senior  leadership  of  an  organization  as  to  its  role  and  to  build  a  consmsus  about 
the  need  for  that  system.  The  Navy  uses  its  POM  games  for  just  this  purpose.  POM  games 
ate  not  die  time  to  explore  new  technologies,  but  rather  to  ensure  that  employment  of  the 
program  can  be  well  articulated. 

During  the  inter-war  years,  the  Navy  and  War  Departments  cooperated  in  the  development  of 
war  plans  by  the  Joint  Planning  Committee.  Reacting  from  their  efforts  was  the  creation  of 
a  war  plan  in  1924  against  Jrpan,  called  War  Plan  Orange.  The  substance  of  Orange  changed 
over  the  years  and  Orange  itself  was  never  used  as  the  actual  blueprint  for  combat  in  the 
Pacific,  but  the  Navy  gamed  campaigns  at  the  Naval  War  CoUege  up  to  the  commencement 
of  hostilities  using  Orange  as  its  basis. 

Orange  as  die  basis  for  a  scenario  for  a  series  of  games  that  were  fought  over  an  extended 
period  of  time  allowed  the  military  to  socialize  its  officer  corps  about  the  likelihood  of  a 
future  war.  When  the  war  came,  those  tegular  officers  who  had  participated  in  these  exercises 
understood  the  basic  concepts  of  the  campaigns  that  would  have  to  be  fought  and  were  at  a 
distinct  advantage.  Years  of  scenario  writing,  simulations,  and  games  over  the  NATO  central 
front  should  yield  us  similar  advantage,  but  the  likelihood  of  diat  war  ever  being  fought  is 
rqiidly  diminishing.  New  scenarios  will  need  to  be  gamed  quickly. 

The  Navy  Maritime  Strategy  is  another  example  of  a  scenario  writing  exercise  that  has  had 
major  influence  on  a  number  of  other  endeavors.  Whether  or  not  you  agree  with  the  Maritime 
Strategy  is  not  as  important  as  the  fact  that  when  the  term  is  uWd  to  naval  officers  in  any 
fleet  today,  the  same  broad  strategic  scenario  comes  to  mind.  Perhaps  most  inqxittantly,  the 
Maritime  Strategy  unified  the  scenario  for  a  future  war  among  the  "barmis"  in  Washington 
who  were  previously  setting  different  contexts  for  the  programs  and  concepts  that  they  were 
advocating.  If  we  were  ever  to  transition  to  a  defense  dominate  world  or  field  significant 
numbers  of  defensive  forces  with  new  technologies,  waigaming  would  be  a  vehicle  that  would 
help  build  a  consensus  for  what  that  war  would  look  like. 

3.  Education.  Long  ago,  lawyers  recognized  tiie  value  of  moot  court  to  assist 
candidates  in  becoming  practicing  attorneys.  When  students  here  have  to  go  through  the  steps 
necessary  to  defend  a  client,  they  have  the  opportunity  to  refine  their  skills  in  such  senings. 
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Players  and  paitic4>ants  in  diese  type  simulatimis  have  the  (^ipoitunity  to  internalize  much 
more  dun  the  facts  of  the  process  being  simulated.  These  type  educaticHud  simulatitxis  only 
make  sense  if  sane  actiaos  are  required  to  be  taken;  a  scenario  is  played  out.* 

The  puipose  of  a  game  may  be  advertised  as  research,  e.g.,  an  exploratioi  of  sane  jMuticular 
coicept  or  facet  of  war,  in  order  to  attract  a  type  of  player  that  might  otherwise  na  attoxl 
an  educatumal  semiiuu  or  course.  In  reality,  however,  the  real  purpose  of  die  game  may  be 
to  educate  senior  operationally-oriented  military  officers  a  politically-oriented  legislators  aboit 
a  new  technical  subject.  In  order  to  acconplish  such  a  covert  educational  exocise,  a  very 
soidiisticated  and  well  thought  out  scenario  is  required. 

Simuladai  and  gaming  may  be  the  most  successful  way  to  educate  some  individuals.  De^ite 
die  fact  diat  diere  are  numerous  articles  and  books  on  some  subjects,  or  diat  there  are  many 
university  level  courses  one  could  take  in  an  area,  the  busy  military  officer  or  senior  civilian 
may  not  have  had  the  of^rtunity  to  do  any  of  these.  Exposure  to  a  well  coistracted 
sin^ation  or  game  with  a  supporting  scenario  might  be  just  the  diort  course  i^essary  to  get 
in^rtant  points  across  to  an  audience  within  the  "system."  It  has  been  my  experience  that 
gaming  is  a  pejorative  term  to  the  military  and  many  officers  are  eager  to  "learn"  from 
such  exercises. 

Similariy,  to  reach  non-technical  experts  or  academics  with  a  message  on  the  limits  of 
technology  or  nulitary  cqiability,  a  well-crafted  scenario  supporting  a  simulation  or  game  is 
an  excellent  mediod  to  force  diese  individuals  to  "crunch  tte  numbers"  and  get  a  bener  feel 
for  what  is  possible.^  Again,  seminars,  courses,  books,  or  articles  could  do  the  same  job, 
but  "experiencing"  the  event  in  a  game  may  provide  an  opportunity  for  learning  that  will  last 
beyond  the  short-term. 

By  their  very  nature,  games  and  simulations  tend  to  focus  investigation  of  outputs  rather  than 
inputs.  This  is  a  worthwhile  goal  for  education  that  is  well  served  by  the  use  of  games  and 
simulations.  As  an  example,  a  war  game  dealing  with  die  AirLand  Batde  or  follow-on 
forward  attack  (FOFA)  operations  will  help  illuminate  the  net  worth  of  either  of  the  concepts 
in  achieving  their  objectives;  not  on  input  measures,  i.e.,  the  intrinsic  nature  of  the  command 
stracture  or  on  the  emerging  technologies  used  or  forces  to  be  purchased. 

Scenarios  used  for  training  and  education  must  be  credible  to  the  participants  and  obviously 
feasible  to  support  the  exercise  within  the  aliened  time  period.  As  we  move  from  scenarios 
used  for  training  and  education  to  those  used  in  support  of  research,  the  requirement  for 
credibility  subsides. 

C.  Relationship  of  Wargaming  to  Other  Methodologies. 

1.  Decision  Making.  Decision  making  during  the  new  era  of  greatly  changed 
threat  perceptions  and  restrained  resources  available  to  defense  can  be  aided  by  varying 
methodologies  and  forms  of  analysis.  Supporters  of  wargaming  have  argued  that  technology 
waigaming  ought  to  be  pursued  as  an  aid  to  decision-making  involving  technology  issues. 
Before  one  can  accept  this  judgment,  it  is  appropriate  to  review  available  methodologies  that 
might  be  used  to  support  decision  making  or  to  develop  alternative  futures  to  see  where  the 
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relatively  new  phenomenon  of  technology  wargaming  might  fit  in.  Among  the  methodologies 
one  can  use  to  support  better  decision-making  in  the  area  of  technology  are: 

a.  Trend  Extrapolation/Curve  Pitting.  Short  range  predictions  of  the  threat 
and  resources  (including  technologies)  available  are  best  performed  by  a  single,  quick,  and 
inexpensive  extiiqwlation  of  current  trends.  This  methodology  is  relatively  easy  to  do  and 
understand.  When  tied  to  history,  most  individuals  are  willing  to  accept  trend  extrtqwlation 
since  they  find  die  data  very  easy  to  accept.  Trend  extrapolation  is  useful  for  identification 
of  very  l^c  fundamoital  relationships,  when  creating  a  baseline  case,  or  to  stimulate  further 
analysis.  It  is  ottremely  useful  in  scenario  writing  and  gaming  where  the  time  frame  for  the 
exercise  is  the  near  term.  Trend  extrqiolation  would  be  a  very  acceptable  methodology  for 
forecasting  the  technological  crqiabilities  available  to  own  forces^dustry  or  erwmy  forces/ 
industry  in  the  near  term.  Technology  decision  makers  already  use  this  methodology  to 
forecast  technologies  available  out  through  IS  years.  Political  scientists  are  more  accustomed 
to  using  this  method  to  predict  out  to  6  months. 

The  decision  of  where  to  start  the  trend  is  often  arbitrary  and  trend  extrqiolation  is  often 
based  upon  the  sometimes  faulty  assumption  of  continuity  (historical  data  points  rarely  all  fall 
on  a  straight  line).  By  itself,  trend  extrapolation  does  not  produce  more  sophisticated  causal 
relationshq>s  and  does  not  allow  the  introduction  of  theory  into  forecasting.  This  technique 
sometimes  gives  unwarranted  credibility  to  findings  and  is  poor  for  long-range  forecasts  which 
are  of  interest  to  many  decision  makers.  Elespite  these  drawbacks,  the  low  cost  and  simplicity 
of  trend  eitr^lation  make  this  technique  likely  to  be  used  in  the  future. 

b.  Leading  Indicators  is  prediction  of  the  direction  of  change  by  monitoring 
secondary  indicators.  This  method  also  is  relatively  quick  and  very  easy  to  understand. 
Leading  indicators  tqipears  to  work  in  economics,  intelligence  (indicators  and  warning),  and 
as  methods  of  predicting  direction  of  change;  hence  it  would  appear  to  have  great  value  in 
understanding  the  direction  of  movement  or  interest  that  organization  or  government  decision 
makers  have  in  technology  or  other  issues.  Leading  indicators  is  unable  to  predict  magnitude 
of  change  or  the  value  of  that  change;  follow-on  games  and  simulations  might  be  of  assistance 
here.  Leading  indicators  has  limited  explanatory  value,  but  great  value  in  pointing  out  areas 
that  need  in-depth  and  follow-on  analysis.  It  should  form  the  basis  of  requirements  given  by 
laboratories  to  intelligence  agencies.  An  adaptation  of  leading  indicators  would  be  the  formal 
content  analysis  of  the  writings  of  world-class  scientists  to  determine  their  direction  of 
movement  for  new  research. 

c.  Cross-Impact  Matrix  Analysis.  This  method  is  relatively  simple  and 
forces  consideration  of  basic  relationships,  e.g.,  the  technological  capabilities  of  nations  listed 
with  other  measurable  attributes.  Once  these  relationships  are  articulated,  multiple  analyses 
(and  especially  sensitivity  analysis)  can  be  performed  at  a  fairly  low  cost.  The  initial 
development  of  a  matrix  is  tedious  and  extremely  reliant  on  expert  judgment  which  is  a 
methodology  that  has  its  own  drawbacks.  Cross-hnpact  matrix  analysis  ignores  the  fact  that 
tire  order  in  which  events  occur  can  change  results  because  of  synergistic  relationships,  and 
it  assunres  lirrear  effects.  Another  problem  widi  this  methodology  is  that  double  counting 
may  occur.  The  high  numbers  of  variables  required  for  technology  planning  would  require 
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eactremely  conifdicated  matrices  in  this  area.  Developing  the  initial  model  is  probaUy  too  time 
amsummg  and  difficult  for  this  method  to  be  very  attractive  to  defense  technology  planners. 

d.  Regression  Analysis  is  prediction  of  single  trends  or  evoits  based  upon 
its  relationship  to  odier  events  or  another  sin^e  event.  Essentially  this  is  a  more  sophisticated 
form  of  trend  extrqwlation  with  greater  and  more  coiiq>rehemive  causal  and  theoretical 
content  .'.egtessicm  analysis  usually  presumes  relationships  are  linear.  It  assumes  that  we  can 
predict  future  values  fmr  all  variables.  The  more  variables  that  are  included,  the  less  reliable 
the  estimated  parameters  become.  If  the  "system"  changes,  the  relaticHish^  betweoi  variables 
must  also  change.  Regression  analysis  often  leads  to  inductive  "discovery"  of  variables  which 
may  derive  spurious  relationships  (do  you  need  a  tfieory  fost?). 

e.  Analogy.  This  technique  is  also  quick,  inexpensive,  and  accef^able  to 
most  individuals.  For  exanq>le,  Wayne  Hughes  has  studied  the  introduction  of  new 
technologies  during  a  war  and  suggested  that  the  evidence  is  that  no  new  technology  will  be 
produced  during  a  war  that  will  not  "leak"  to  the  enemy  nor  be  able  to  be  countered  by  the 
enemy.'  This  would  suggest  to  technology  managers  and  planners  diat  a  good  hedging 
strategy  for  a  nation  would  be  to  not  count  on  emerging  technologies  to  be  war  winners. 

Historical  analogy  has  value  in  helping  decision-makers  and  analysts  in  understanding  a  present 
problem.  Military  officers,  especially,  and  most  government  officials  ate  very  comfortable 
with  historical  an^ogy.  In  extreme  cases,  historical  events  are  often  elevated  to  the  status  of 
a  myth  which  may  be  extremely  difficult  to  overcome.  Historical  data  is  often  transformed 
to  lode  like  the  "present"  situation,  but  the  different  context  for  this  historical  situation  is  often 
overlooked.  Analogy  assumes  the  world  will  continue  to  operate  as  in  the  past,  when  aU  the 
key  actors  ate  consciously  aware  of  the  failures  and  mistakes  of  the  past  and  are  attempting 
to  avoid  repeating  those  mistakes.  The  value  of  analogy  for  technology  planners  is  primarily 
in  gaining  insights  over  the  management  of  change  in  large  organizations  and  then  using  diose 
insights  to  help  introduce  change.  In  doing  so,  path  gaming  (described  below)  can  be  veiy 
helpful  in  identification  of  key  decisions  that  will  be  required  and  road-blocks  to  change. 

f.  Expert  Judgment  is  an  unparalleled  source  of  insight  and  iimovation.  It 
serves  as  a  link  between  real  and  theoretical  wodds  and  is  often  drought  to  be  a  low  cost 
alternative  to  many  other  methodologies.  Expert  judgment  is  a  way  to  probe  the  future 
without  being  restrained  by  methodologies,  and  it  is  often  very  inexpensive  (the  price  of  a 
book).  Expert  judgment  is  often  and  correctly  used  in  scenario,  simulation  and  game  creation, 
the  play,  and  subsequent  analysis  of  games.  It  would  be  essential  in  any  technology  game. 
An  adq>tation  of  expert  judgment  would  be  the  formal  content  analysis  of  the  writings  of 
individual  world-class  scientists  to  determine  their  positions  and  directions  of  movement  for 
new  research. 

Unfortunately,  true  renaissance  men  are  hard  to  find  although  there  is  no  dearth  of  "experts" 
available  to  argue  any  side  of  any  issue.  Expert  judgment  can  be  extremely  personality  driven. 
It  has  an  uneven  record  as  a  predictive  methodology.  The  results  are  not  reproducible  nor 
easy  to  validate  and  the  credibility  of  the  prediction  relies  solely  on  the  credibility  of  the 
"expert"  making  it.  Expert  judgment  is  usehd  for  in-depth  background  on  issues.  The  defense 
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plamier  will  probably  continue  to  use  genius  forecasting  as  integrated  with  other 
mediodologies,  but  sh^d  probably  avoid  using  it  alone. 

g.  Brainstorming  is  generally  inexpensive  and  a  tiiite-honored  mediodology 
which  is  likely  to  continue  to  be  used  in  all  planning  envmmments.  It  oftra  stimul^es 
creative  diou{^  and  also  ties  nicely  to  scenario  develt^xnent,  simulatitms  and  games. 
Brainstotming  is  also  very  driven  by  personalities  (the  bias  will  be  often  to  ensure  "big”  names 
are  included)  and  face-to-face  intimidation  and  groupthink  problems  are  difficult  to  overctmie. 
Tedmology  gaming  is  very  likely  to  need  to  use  brainstorming  prior  to  and  after  any  war 
game  that  makes  use  of  emerging  c{q)abilities  that  are  not  well  understood  by  the  average 
person. 


h.  Delphi  in  theory  obtains  expert  opinion  without  time  consuming  interviews 
and  without  problems  of  personality  domination  by  experts  with  large  egos.  Technology 
planners  can  use  this  methodology  to  get  die  opinion  of  scientists  throughout  the  world.  It 
is  an  economical  way  to  engage  large  numbers  of  diverse  people  with  minimum  effect  on 
individual  schedules.  A  claimed  strength  of  this  method  is  that  it  can  identify  and  narrow 
consensus  throu^  an  iterative  process.  An  adaptation  of  Delfdii  would  be  the  formal  content 
analysis  of  the  writings  of  world-class  scientists  to  determine  dieir  positions  and  directions  of 
movement  for  new  research. 

There  is  no  proof  that  convergence  of  opinion  forms  correct  answers.  Delphi  gives  undue 
en^ihasis  to  the  majority  and  assumes  all  experts  have  equal  knowledge  of  die  subject. 
Fur^tmore,  there  is  no  basis  that  Delphi  is  a  valid  methodology  for  long-range  forecasting 
or  predictive  theory.  The  heavy  reliance  of  Delphi  on  expert  opinion  places  a  heavy  burden 
on  the  original  staftf  selection  of  experts.  Delphi  also  provides  no  insight  on  how  these  experts 
arrived  at  their  conclusions.  Delphi  is  often  used  due  to  faith  in  experts  and  pseudo-scientific 
veneer.  It  can  be  used  when  no  other  method  is  available  because  of  time,  staffing  or  other 
restraints,  but  should  be  used  with  full  recognition  of  its  limitations. 

2.  Scenario  Building.  A  scenario  is  defined  herein  as  a  statement  of  the 
assumptions  made  about  the  international  politico-military  or  technical  environment.*  Scenarios 
can  be  tailored  to  a  specific  object  or  environment  and  often  can  be  incorporated  directly  into 
a  strategy.  They  can  be  tested  against  several  plausible  environments.  When  combined  with 
expert  judgment  or  brainstorming,  it  can  very  often  lead  to  creative  thought,  can  explicitly  deal 
with  the  effect  of  decisions,  and  can  feed  into  simulations  and  games.  Scenario  building  is 
currently  used  by  experts  to  forecast  technologies  available  beyond  the  IS  year  mark. 

The  credibility  of  a  scenario  rests  on  expert  judgment  and  the  craftsmanship  of  the  scenario 
builders.  Scenario  building  can  lead  to  idle  speculation  without  the  contributors  being  held 
responsible.  Planning  scenarios  can  and  often  have  taken  on  a  life  of  their  own  despite  the 
fact  that  they  are  not  predictive.  If  comprehensive,  scenario  building  can  be  very  manpower 
intensive. 

"Surprise  and  the  Single  Scenario"  is  the  title  of  a  rather  thought  provoking  article  by  Sir 
James  Cable.*"  The  essence  of  his  article  is  that  nations  should  not  prepare  their  militaries 
with  just  one  contingency  in  mind.  For  example,  should  U.S.  military  forces  be  procured  with 
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the  assunqjtioii  diat  they  will  retain  a  technological  edge  over  their  likely  enemy  or  that  this 
enemy  is  likely  to  have  technological  parity?  Should  U.S.  c<mventi(Hud  forces  be  procured 
with  die  requirement  to  be  useful  against  the  most  robust  technologically  equal  enemy  but 
vdiose  engagraient  in  combat  is  least  likely  or  against  more  likely  and  less  technologically 
ciqiable  enemies.  The  scenarios  used  for  analysis  by  experts  or  for  games  and  simulations  are 
oftai  cracial  to  the  outcome  of  that  aiudysis  or  the  game. 

3.  Simulations  &  Games.  Simulations  and  games  can  provide  easy  manqHilation 
of  model  data,  parameters,  large  number  of  variables,  and  sensitivity  analysis.  Generally,  they 
force  the  analyst  to  make  explicit  assumptions  and  to  identify  fundamental  relationships.  Once 
constructed,  diey  can  make  multiple  runs  quickly  and  at  low  cost.  Simulations  a^  games 
provides  the  opportunity  for  experimentation  and,  with  the  use  of  expert  systems,  the  biases 
of  stnmg  persoiutlities  can  be  r^ced. 

Simulations  and  games  have  a  strong  bias  in  favor  of  variables  than  can  be  quantified,  and 
generally  assumes  the  ability  to  identify  all  variables  and  express  them  in  mathematical  terms. 
The  difficulty  in  factoring  in  non-quantifiable  data  (the  "fog  of  war")  and  validation  of  many 
military  models  is  often  overlook^  or  too  difficult  to  solve.  Initial  development  costs  for 
games  and  simulaticms  are  often  quite  high  and  they  can  often  be  manpower/resource  intensive. 

Games  ate  difficult  to  reproduce  and  very  often  lack  documentation  of  what  h^jpened  and 
why  decisions  were  made  (transparency).  Where  automated  players  are  used  with  expert 
systems,  documentation  for  rules  is  often  lacking.  Games  can  be  mistaken  for  analysis  and 
their  results  are  often  oversold  or  given  unwarranted  credibility.  When  tied  to  faulty  expen 
judgment,  brainstorming,  or  scenario  writing,  a  war  game  can  magnify  the  errors  that  have 
been  introduced  by  bad  inputs.  The  unintended  consequences  of  wargaming  by  the  Soviet 
military  under  Stalin  and  in  prewar  Jq>an  had  a  dramatic  and  negative  impact  on  the  conduct 
of  these  forces  in  World  War  n. 

Scenarios  and  war  games  are  also  used  to  support  technical  evaluation  of  weiqx>ns  systems." 
Scenarios  and  games  in  support  of  such  evaluations  must  adequately  define  the  spectrum  of 
a  wetqwns  system’s  operating  environment  so  that  a  full  and  balanced  evaluation  can  be  made 
of  its  ctq>abilities.  Whereas  scenarios  and  wargaming  used  in  support  of  technical  evaluations 
can  be  overcome  widi  good  analysis,  in  the  social  sciences  one  can  argue  that  the  scenario 
or  a  war  game  can  even  predestine  the  results  of  analysis." 

As  more  people  in  the  defense  establishment  become  increasingly  comfortable  with  computers, 
this  method  will  become  more  popular  (although  games  and  simulations  do  not  require  the  use 
of  conqniters).  Its  greatest  drawback  remains  our  inability  to  quantify  factors  like  morale, 
nationalism  or,  especially,  completely  irrational  acts.  Hard  core  supporters  of  games  and 
simulations  are  opposed  by  hard  core  opponents. 

4.  Field  Testing.  The  most  valid  data  that  can  be  gathered  on  a  subject  is  by 
direct  testing  in  the  appropriate  field  environment.  live  fire  testing  of  weapons  systems  can 
yield  ettqrirical  data  diat  is  far  superior  to  extrt^lations  of  trends,  analogy,  expen  judgment, 
sinailaticnis,  etc.  The  obvious  drawback  is  the  costs  or  absolute  inability  to  conduct  field 
tests  in  order  to  obtain  data.  For  example,  the  costs  of  sinking  a  NIMITZ  class  aircraft  carrier 
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preclude  this  method  of  learning  how  many  torpedoes  or  cruise  missiles  it  could  absort)  in 
combat.  Similarly,  we  must  use  surrogates  for  nuclear  war  in  or^r  to  study  it.  Where  field 
operations  or  testing  can  be  integrated  with  simulations  and  games,  as  is  being  done  with 
SIMNET,  we  qtpear  to  have  the  best  of  both  worlds. 

S.  Conq>ilations  of  Existing  Studies.  The  fitud  methodology  to  be  considered  is 
to  singly  aggregate  the  existing  body  of  studies  on  an  issue  and  produce  a  consensus  report 
or  a  conqtilatirm  of  all  existing  reports.  Aldiough  this  is  an  inexpensive  methodology,  it 
assumes  that  sufficient  numbers  of  studies  have  been  done  that  will  expand  the  range  of 
current  ctmsiderations.  Con^ilations  also  assume  that  the  error  of  the  average  is  likely  to  be 
less  than  (or  at  worst  equal  to)  the  average  error  of  the  individual  studies. 

(jood  conqtilations  point  out  when  the  studies  disagree,  but  may  introduce  a  false  impression 
of  how  much  disagreement  there  is  in  individual  reports.  Out  of  date  and  urueliable  studies 
are  often  included  and  given  equal  weight  to  others  that  have  proven  more  trastworthy. 
Conqtilations  can  inspire  more  confidence  than  they  deserve.  This  method  is  likely  to 
continue,  especially  in  a  "Joint"  and  intelligence  environment. 

n.  PAST  APPUCATIONS  OF  WARGAMING  TO  TECHNOLOGY  ISSUES 

A.  Navy  Background. 

The  Global  War  Game  at  the  Naval  War  College  (NWC)  began  over  5  years  ago.  About  two 
years  into  the  game,  Navy  scientists  and  engineers  sought  a  way  to  have  an  effective  role  in 
the  game.  An  "exchange"  scientist  at  NWC  developed  the  concept  of  an  Advanced 
Technology  Cell.  While  Global  was  covering  the  5  years  of  the  POM,  it  was  stiU  believed 
a  science  assistance  would  be  possible  for  Fleet  commanders.  The  Cell  consisted  of  Scientists 
and  Engineers  from  Navy  Centers  who  met  during  the  game  to  work  on  technical  problems 
defined  during  the  play  of  the  game.  The  Navy  Scientific  Assistance  Program  (NSAP)  and 
Director  played  a  significant  role  by  interacting  with  the  various  Conunands  to  provide 
assistance.  Thus,  technology  was  injecting  itself  into  the  game. 

Basically,  the  Cell  was  deemed  not  to  have  a  significant  role  in  the  game  as  there  was  no 
mechanism  to  integrate  and  play  effectively  the  new  systems  developed  by  the  Oil.  It  should 
be  noted  that  the  people  participating  in  the  CeU  were  benefitted  from  an  educational 
viewpoint,  and  many  took  their  experiences  back  to  their  Laboratories  to  help  them  in 
performing  R&D  tasks  in  a  more  operational  and  global  view. 

Also,  there  was  established  a  War  Emergency  type  board  consisting  of  senior  Navy  officials 
(civilians  and  retired  military)  who  play  the  Wi^  role  of  defining  "show  stopper"  projects 
(like  the  Manhattan  Project).  The  Board  visited  the  Fleet  Commands  on  the  floor  of  the  Game 
to  define  their  needs.  This  was  an  educational  process  for  the  players  on  the  Board  and 
became  a  source  of  many  good  philosophical  discussions.  However,  it  did  not  effectively 
play  in  the  Global  Game.  Thus,  technology  injection  into  the  war  game  did  not  work  well. 
NWC  ^ided  to  separate  die  two  and  create  the  Technology  Initiatives  Game  (TIG)  process 
where  the  war  game  was  injected  into  the  technology. 
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Prior  to  the  first  TIG,  NWC  conduct^  a  number  of  seminar  gones  (see  Table  B-1)  at  die 
Navy  Onters  to  describe  new  processes,  educate  Center  personnel,  and  try  seminar  techniques. 
NWC  also  defined  several  scenarios  based  on  the  Global  Game  scenario  and  game  events  (also 
a  Lie  scenario  for  the  TTG).  These  were  ctmstnicted  into  d^ailed  game  bodes  including 
descrqMions  of  Navy  systems. 

Table  B-1.  Seminar  War  Game  List. 

R&D  Cotter  Games 


Organizatitm  Seminar  War  Game  Date  Focus 


NADC 

09-11  Dec  85 

ASW 

NADC 

02-03  Apr  86 

TACAIR 

NAC 

14-15  Oct  86 

TACAIR 

NUSC 

04-05  Nov  86 

ASW  in  N.  Atlantic 

NADC 

03-05  Dec  86 

Battle  Force  C 

DTRC 

13-15  Jan  87 

Adv  Veh  &  Syst-2010 

NOSC 

04-06  Mar  87 

Pacific  Theater 

NCSC 

31  Mar-03  Apr  87 

Year  2000  Ops  in  N  Pac 

DOE-LLNL 

21-23  Apr  87 

Navy  TACNUC  Warfare 

NAC 

15-16  Jun  87 

Air  ASW 

NSWC 

05-07  Oct  87 

Arctic  Amphib  Ops 

NSWC 

16-17  Nov  87 

Terrorism 

JHU/APL  (SPAWAR)* 

19-20  Nov  87 

CVBF  TLWR  Sem-NW  Pac 

JHU/APL  (SPAWAR)* 

15-17  Dec  87 

CVBF  TLWR  Sem-Norway 

JHU/APL  (SPAWAR)* 

26-29  Jan  88 

CVBF  TLWR  Sem-Jutland 

NAC 

01-02  Mar  88 

21st  Century  Technol 

JHU/APL  (SPAWAR)* 

09-10  Mar  88 

CVBF  TLWR  Sem-3td  Wrld 

Army  LABCOM 

28-31  Mar  88 

Emerging  Tech’s  Impact 

NOSC 

11-13  Apr  88 

Pac  Theater  Adv  Tech 

NUSC 

25-26  Apr  88 

Adv  Tech  Strat  Planning 

HI-RES90 

25-29  Sep  89 

CSWG  +  Table  Top 

*  Played  in  support  of  Warfare  Systems  Architecture  and  Engineering  tasks. 

Other  Advanced  Concept  Games 

Organization 

Seminar  War  Game  Date 

Focus 

OSD 

1985 

SDI 

OSD 

1986 

SDI 

SPAWAR 

Jan  87 

Path  Game 

SDIO 

July  89 

SDI 

SDIO 

Sep  89 

SDI 
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In  TIG88,  the  game  was  played  over  three  weeks.  A  group  was  established  for  each  scenario 
and  during  the  three  we^,  the  Blue  force  was  changed  relative  to  the  conditions  of  die 
budget  (increased,  decreased,  status  quo).  The  group  consisted  of  technologists,  <^rators, 
and  acquisition  managers.  In  general,  the  technologists  controlled  the  game  (versus  operators). 
The  flow  was  to  define  the  event,  decide  on  the  play  including  the  need  for  new  systems 
based  on  currmt  or  future  technology,  and  assess.  An  example  would  be  the  definition  of  a 
new  cruise  missile  with  longer  range,  improved  precision  guidance,  and  an  ability  to  condua 
Battle  Damage  Assessment  (BDA).  The  Game  was  documented  and  technology  areas  and 
priorities  were  specified  by  doing  a  synthesis  of  results  across  the  three  weeks  and  several 
scenarios. 

The  OPNAV  ^nsor  decided  TIG  88  was  too  broad  and  wanted  the  operators  to  be  more 
involved  (technologists  provide  support  -  also  decrease  in  use  of  acquisition  managers).  Thus, 
TIG89  focused  on  several  problems  that  were  current  in  the  OPNAV  POM  process  and  related 
to  technology  investment.  TIG  89  assessed  advanced  cruise  missiles,  RPVs,  and  mission 
planning.  It  should  be  noted  that  it  was  a  very  timely  choice  as  the  POM  was  discussing 
program  definitions  so  the  game  was  not  a  threat  to  existing  programs.  Thus,  the  plan  was 
for  the  game  to  provide  a  product  for  OPNAV  use  in  defining  an  investment  plan  for  these 
systems.  TIG89  remained  a  seminar  game  and  documentation  is  currently  being  distributed. 

The  Director  of  Navy  Laboratories  has  sponsored  an  annual  war  game  at  NWC  for  S&Es 
from  Navy  Laboratories.  Fleet  Commanders  play  Blue  and  Red  forces.  While  it  is  not 
strictly  a  technology  game  but  a  game  for  education  of  the  S&Es,  advance  technology  system 
concepts  are  played  on-  and  ofi^line. 

B.  Anny  Background. 

U.S.  Army  Laboratory  Command  (LABCOM)  introduced  three  innovations  to  the  Army 
technology  base:  a  comprehensive  TBIS;  an  annual  Tech  Base  Investment  Strategy  Conference 
(TBISC);  and  Army  tech  base  wargaming.  In  1986,  LABCOM  first  implemented  the  TBIS 
for  the  technology  base  of  its  Research,  Development,  and  Acquisition  (RDA)  process.  The 
first  TBISC  was  held  22  Febtuary-4  March  1988,  and  the  first  Tech  Base  War  Game 
(TBWGl)  was  held  during  the  period  28-31  March  1988.  TBWGl  was  played  as  a  CSWG, 
and  involved  conventional  warfare  in  Europe  in  the  year  2015.  It  had  three  objectives:  gain 
insight  into  the  effectiveness  and  military  utility  of  notional  systems  and  the  emerging 
technologies  they  embody;  educate  tech  base  managers  on  the  relationship  between  technology, 
strategy,  tactics,  and  scenarios;  and  expose  military  personnel  to  the  potential  of  advanc^ 
technology.  While  this  single  war  game  could  not  provide  definitive  conclusions,  it  did 
provide  insights  that  are  the  drivers  for  further  analysis.  LABCOM  is  now  engaged  in  the 
process  of  institutionalizing  wargaming  as  part  of  the  TBIS.  Bi-annual  tech  base  war  games, 
on  the  level  of  TBWGl,  are  planned  which  will  provide  input  to  higher  resolution  games  and 
traditional  simulation  analyses  which  will  be  performed  in  the  interim  between  the  TBWG’s. 

A  CSWG  and  a  higher  resolution  table-top  war  game  were  played  at  Natick  Research, 
Development,  and  Engineering  Center  (NRDEC)  in  September  1989.  These  games  had 
scenarios  similar  to  TBWGl,  but  emphasized  and  were  driven  by  issues  which  either  arose 
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from  TBWOl  or  were  particularly  relevant  to  specific  missions.  It  is  eiqjected  diat  these 
higher  resolution  games  will  drive  fiiiriier  analysis  with  closed-form  simulati<»is. 

TBW02  is  idanned  for  the  spring  of  1990.  It  will  have  a  differait  scenario  than  that  of 
TBWGl.  Macro-level  issues  (questions)  will  include:  what  will  the  future  batdefidd  lode 
like;  what  doctrinal  changes  will  be  required  to  fight  on  that  battlefield;  what  new  systems  will 
be  needed  and  how  will  they  be  deployed;  what  force  structure  will  be  irec^sary  to  support 
die  new  systems;  and  what  qiecial  ddlls  or  technologies  will  be  required  to  operate,  maintain, 
and  supply  diose  systons.  Ultimately,  as  tlw  process  matures,  batdefield  utilities  of  die 
next-generation  and  future  systems  to  be  used  in  die  TBIS  will  be  generated. 

C.  Air  Force  Background. 

Lockheed  ccmimissioned  an  internal  study  to  define  requirements  for  a  new  airlift  aircraft. 
The  study  used  seminar  gaming  to  look  at  six  conceptual  systems  using  new  or  available 
technology  for  the  time  frame  selected.  The  output  of  the  games,  which  looked  at  both  SW 
Asia  and  European  Theaters,  were  two  detailed  scenarios  for  use  by  analytic  study  to  decide 
on  the  best  option  for  the  aircraft.  The  Air  Force  has  since  conducted  follow-on  studies. 

In  the  mid-1980s,  the  Air  Force  brought  together  a  group  of  officers  to  assess  technology 
across  a  setting  of  four  different  worlds  for  the  future  such  as  die  status  quo,  peace,  etc.  This 
was  followed  by  the  Air  Force  Project  Forecast  n  work  which  used  a  seminar-like  process. 

D.  Nuclear  Background. 

A  series  of  14  games  to  assess  emerging  technology  was  played  between  1984  and  1987  by 
the  Nuclear  Strategy  Development  Group.  Sponsors  were  DNA,  OSD/NA,  SDIO,  USDRE 
AE,  JAD,  and  T/SNF. 

E.  Problems/Limitations  -  Community  Perceptions. 

1.  Technology  Cell  Team.  If  a  group  is  very  broad  based  in  experience 
(technology,  operational,  and  acquisition),  die  seminar  discussion  benefits  from  die  creativity 
and  synergism  of  ideas.  This  can  be  very  useful  on  conceptual  solutions  to  problems  and 
issues.  In  general,  technology  games  are  looking  to  gain  insight  on  poorly  defined  issues 
which  will  probably  required  application  of  technology.  The  game  could  be  very  broad  to 
lode  at  technology  needs  in  general  or  could  be  ^cL&c,  looking  at  the  investment  need  of 
a  single  science  and  technology  area  (areas  defined  by  OSD).  The  problem  is  what  is  the 
most  effective  team.  Issues  are:  Should  very  technology-specific  expertise  versus  broad-based 
technology  expertise  be  used?  Does  operator  or  technologist  lead  and  control  the  team? 

2.  Type  Game.  Current  technology  games  have  been  seminar  focused.  This 
q>pears  very  useful  in  conceptualizing  systems  to  solve  the  problem.  On  the  other  hand,  a 
seminar/analysis  game  could  be  used.  Where  the  analysis  by  simulation  could  give  insight 
to  the  partic^ants  or  answer  specific  questions.  The  problem  is  should  the  technology  games 
remain  in  the  seminar  format  or  move  mote  toward  seminar/analysis  format. 
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3.  Rqxntmg  and  Analysis.  Cunent  Navy  and  Anny  technology  games  have  been 
documented  so  an  audit  trail  is  possible.  In  some  cases,  it  was  more  documentation  than 
analysis  of  results.  Bodi  take  time  and  are  costly.  It  has  also  been  found  that  die  ganne  must 
be  documented  before  die  players  leave  dw  game.  The  problem  is  how  much  analysis  of 
results  is  required  and  what  should  be  done  whh  the  product. 

4.  Game  Material.  The  game  books  were  well  prepared  and  ctmtained  much 
data  and  information.  They  did,  however,  require  reading  before  the  game  or  liome-wotk" 
during  the  game  to  utilize  them  fully.  Typically,  the  players  relied  <m  dieir  experioice  and 
didn’t  effectively  use  die  books.  PC  data  bases  are  being  developed  that  could  be  provided 
to  give  players  very  easy  access  to  system  performance,  threat,  etc.  An  qieraticm  of  the  PC 
would  make  the  program  even  more  useful.  Another  q;>tion  is  to  brief  the  information  at  the 
start  of  die  game  using  a  system  expert/advocate.  The  problem  is  how  to  present  information 
to  die  players  in  a  productive  form. 

5.  Tactics.  It  is  clear  that  newly  conceptualized  systems  will  requite  differoit 
tactics  to  optimize  system  operational  performance.  This  is  conqiounded  when  several  new 
systems  ate  to  be  gamed.  It  was  noted  that  future  games  may  have  to  be  done  in  {diases 
where  {diase  1  postulates  systems  and  the  next  fdiase  is  an  iteration  of  tactics.  Anodier  optimi 
is  to  preplay  ccmcepts  with  operators  so  the  game  can  use  a  set  of  tactics  tailored  to  proposed 
concept(s).  The  problem  is  to  define  a  process  that  can  reasonably  integrate  new  technology 
with  new  tactics. 

6.  Special  Access  Program.  From  a  scientific  viewpoint,  it  would  be  best  to 
bring  all  information  to  bear  on  a  technology  problem.  On  the  o^er  hand,  national  security 
may  preclude  discussing  a  particular  technology  in  a  broad  forum  or  even  a  single  S&T  area 
forum.  Curiendy,  the  technology  games  are  at  the  GENSER  level.  Hie  problem  is  to 
determine  a  way  to  make  use  of  all  available  information  when  using  the  product  to  make  the 
best  investment  strategy.  Possible  solutions  to  SAP  restrictions  include: 

•  In  seminar  gaming  or  seminar/analysis  gaming,  the  game  direction  could  be  given 
maximum  values  for  detection,  accuracy,  etc.,  that  can  be  conceptualized/assumed/ 
hypothesized. 

•  Play  GENSER  game  and  dien  appropriate  official  gives  the  outcome  to  special  off-line 
ceU  to  play  relative  to  a  specific  SAP  for  credibility  of  game  results. 

•  Play  certain  issues  off-line  in  special  ceU  and  iiqiut  as  given  to  technology  game. 

7.  World  Changes.  Most  games  have  been  played  as  Red  versus  Blue.  The 
current  world  changes  are  likely  to  require  "Rainbow"  versus  Blue.  Thus,  the  threat  definition 
is  more  ctmqrlex.  The  value  system,  policy,  and  geography  ate  much  less  understood,  and 
expertise  level  in  these  areas  doesn’t  have  a  lot  of  dq)ft.  This  will  impact  the  need  for 
technology,  rules  of  oigagement,  tactics,  etc.  The  problem  is  how  to  bound  the  threat  and 
understand  it  well  enough  to  play  a  realistic  technology  war  game. 
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8.  Lie.  Some  believe  systems  devel<^)ed  to  fight  Red  are  suffident  to  fight 
"RaitdKm”,  Le.,  LlC  situatums.  Thus,  ^)ecial  technology  games  for  LlC  would  not  be 
required.  Odiers  note  that  UC  does  not  inq)ly  low  tech  and  diat  high  tech  wifo  ^)ecial  tactics 
will  be  retpured.  The  question  is  do  you  n^  to  run  technology  games  for  LIC  scouuios. 

9.  Envinmment.  All  Services  foce  difficult  envinmments  such  as  poor  visibility, 
unsuitaUe  road  c(mditi<»is,  high  sea  states,  ete.  As  technologists  begin  to  concqitualize  hi^ 
technology,  the  disadvantage  of  the  technology  in  a  given  poor  mvironmmt  can  have  a 
significant  impact  oa  the  effectiveness  of  the  new  concept.  The  problem  is  T«hen  and  how 
to  introduce  envirmmental  limitations  into  the  technology  game. 

10.  C*.  The  systems  have  become  very  information  intensive.  Engagemoit 
cmitrol  can  rest  with  the  President  or  the  platoon  leader.  In  general,  C  is  difficult  to  model 
or  understand  in  a  seminar  game.  If  simulation  is  being  used  in  the  game,  a  ctmeem  exists 
regarding  the  computer’s  ability  to  handle  C  in  game  real  time.  The  problem  is  how  to 
ctmsider  die  impact  of  C  in  a  technology  game. 

11.  Sponsorstiqi.  The  Navy  and  Army  TIG  are  under  the  ^nsorshq)  of 
headquarter  organizations  responsible  for  technology  investment  strategy.  In  the  Navy  case, 
NWC  proposed  the  HG,  and  OPNAV  agreed  to  sponsor  it.  They  now  are  tailoring  ^  HG 
to  meet  critical  investment  strategy  needs.  In  the  Army  case,  LABCOM  saw  the  need  to 
qxmsor  HGs  and  has  developed  a  process  to  meet  their  investment  strategy  needs.  The 
problon  is  to  assure  such  qxmsorship  continues  and  that  OSD  and  the  AF  also  qionsor  such 
games  so  DOD  can  stracture  a  technology  investment  strategy  using  all  the  tools  and 
infonnatimi  available. 

12.  Concepts/Controls  Pre*Game.  Previous  SEACON  and  TIG88  games  were 
open  regarding  the  number  of  concepts  that  were  played.  Also,  the  objectives  and  construct 
of  the  game  should  be  structured  to  meet  the  sponsor’s  needs.  Current  SEACON  and  TIG  89 
games  constrained  the  number  of  new  concepts  and  areas  to  be  studied.  The  problem  is  to 
decide  on  the  qipiopriate  number  of  concepts  to  be  studied  and  to  specify  clearly  the 
objectives  of  the  sponsor  for  the  game. 

m.  POTENTIAL  APPUCATIONS  OF  WARGAMING  TO  TECHNOLOGY  ISSUES 
A.  Inappropriate/Appropriate  Problem  Types. 

A  method  of  choosing  problems  sqipropriate  for  technology  gaming  should  be  imbedded  in  a 
goieral  theory  of  technology  gaming.  For  this,  a  theoretical  framework  must  be  constmeted 
which  defines  areas  of  applications  and  criteria  for  selecting  problems,  huqipropriate  problems 
include  those  that  are  so  well  defined  that  they  can  be  accurately  models  in  clo^  form. 
This  would  include  problems  for  which  man-in-the-loop  effects  either  can  safely  or 
intentionally  ignored,  or  can  be  represented  by  some  form  of  AI  or  empirical  distributions 
which  represent  the  human  decision-making  process.  Problems  involving  conceptual  systems 
for  which  performance  parameters  are  vague  and  operational  concepts  are  primitive  are 
tqjprofniate  for  seminar  wargaming.  The  seminar  process  illuminates  the  problem  and  clarifies 
the  operational  context.  The  ^ctium  of  problem  definition,  from  the  ill-defined  to  the  well 
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defined^  spans  die  space  of  modeling  techniques  from  seminar  wargaming  to  traditional 
closed-form  analysis. 

B.  Potential  Applicatirms. 

One  potential  spplicatkm  of  TWO  is  the  direct  assessment  of  emerging  technologies.  The 
usual  qiproach  is  to  embody  technologies  in  concqitual  systems.  Often  these  systons  have 
no  precursor  and  so  require  some  force  design.  An  example  of  this  type  of  game  is 
LABCOM’s  TBWQl.  However,  in  such  a  game  it  is  difficult  to  inqwssible  to  separate  the 
effects  of  one  system  from  another’s,  let  alcme  assess  die  impact  of  die  onbodied  technology. 
A  better  qiproadi  may  be  to  run  iterations,  with  a  gaming  model,  in  whidi  a  single 
technology  was  em|diasized.  This  emfriiasis  could  be  realized  in  either  of  two  ways.  One 
could  play  the  conceptual  system  among  conventional  current  systems,  or  die  maximum 
dieoretical  impact  of  die  technology  could  be  modeled  in  a  single  game.  As  an  exanqile  of 
the  latter  method,  the  maximum  effect  of  nano-electronics  on  EW  could  be  assessed  by  setting 
all  relevant  performance  parameters  to  their  theoretical  maximum  and  using  measures  of 
effectiveness  (MOE)  such  as  movement  of  the  FEBA  and/or  force-ratio  capability. 

IV.  CAPABILITIES  AND  UMITATIONS 

A.  General  Cqiabilities  and  Limitations. 

Applicadtms  of  waigaming  must  be  carefully  measured  against  the  desired  problem  resolution. 
Wargaming  has  greatest  potential  m  problem  situations  where  problem  components  are  unclear 
and  relatkmshqis  vague.  The  wargaming  of  technology,  which  has  a  well-defined  conceptual 
base,  but  no  operational  base,  is  very  useful  for  early  develcpment  of  operational  concepts. 
In  fact,  few  alternatives  exist  from  operational  research  which  illuminate  relationships  and 
performance  characteristics,  not  yet  experienced,  as  well.  The  dynamic  synergy  of  watgaming 
is  one  of  die  most  powerful  tools  in  the  researchers  Idt  bag". 

In  the  war  game  experience,  the  players  conceive  relationsh^  and  solutions  to  problem 
cmriponents  which  go  unrecognized  outside  of  die  war  game  environment.  The  products  are 
unique  in  their  quality,  definition,  and  qiplication  and  would  not  be  realized  outside  of  the 
wargaming  environment.  These  insights  can  then  be  applied  to  the  assessment  of  technology. 

There  are  two  major  prerequisites  for  using  war  games  to  assess  the  potential  for  technology 
to  irrqirove  warfighting,  as  have  been  articulated  in  the  TIG89  Methodology.  First,  technology 
needs  to  be  translated  into  new  system  concepts  or  into  impacts  on  current  systems.  Second, 
ctmcepts  for  operation  of  these  systems  need  to  be  defined.  Accon^lishing  these  two  is  a 
major  task  in  and  of  itself  and  the  benefits  accrued  from  these  two  are  almost  as  important 
as  the  results  of  a  war  game  assessment. 

Once  ^ston  and  operational  concepts  are  defined,  war  games  provide  one  option  for  assessing 
potentisd  warfighting  utility.  War  games  provide  a  means  to  expose  concepts  to  qierational 
people  in  a  stractured  retd  world  like  environment.  However,  characteristics  of  current 
wargaming  methods  and  technology  impose  constr^ts  on  the  type  of  results  which  can 
reascmably  be  expected  from  technology  gaming.  Most  importantly  war  games  provide  insights 
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into  tedmtdogy  benefits  and  impacts,  and  are  a  vdiicle  to  identify  related  issues  which  may 
not  have  been  anticqMted.  For  a  variety  of  reasons,  definitive  quantitative  valuation  results 
should  not  be  etqtected  from  war  games  today. 

A  valid  war  game  effectivdy  provides  a  single,  valid  data  point,  and  as  such  provides  data 
on  a  variety  of  factors  (depoiding  rm  the  design  of  the  game)  based  <»  (me  experience  with 
a  qpedfic  set  of  {dayers  under  certain  scenario  conditions.  Ideally,  it  would  be  desirable  to 
rqteat  a  war  game  a  immber  of  times,  and  to  systonatically  vary  key  parametos  in  ord^  to 
increase  confidence  in  the  war  game  results.  Without  adeciuate  rqmtitkm  and  control  of 
intemal  war  game  factors,  win/lose  type  of  measures  caiuiot  be  ccmsidered  g(rad  indicators  of 
technolt^  impact. 

However,  rq)etiti<m  of  war  games  is  often  difficult  if  not  impossible.  Practical  consid»ations 
including  cost  and  maiqwwer  recpurements  are  important  limiters  on  efibrts  to  rq)eat  war 
games.  In  adclhiim,  current  war  games,  both  ctnnputer-based  and  seminar  war  games,  are  very 
sensitive  to  initial  ccmditions  making  the  design  of  rq>lications  difficult  if  not  impossible. 
Finally,  for  tnan-in-the-l<x>p  war  games,  human  factors  are  important  elements  in  war  game 
outomies  which  are  difficult  to  ccmtrol  or  replicate.  (The  human  and  group  performance 
aspects  of  wargatning  are  of  particular  importance  bodi  for  technology  gaming  and  wargaming 
in  general  and  are  discnissed  in  more  detail  below.)  Some  of  these  limitations  can  be 
addressed  by  introducing  a  series  of  scenarios  or  groups  within  a  given  war  game  and  by 
attenticm  devoted  to  analytically  assessing  such  factors  as  player  training  effects. 

B.  Hunum  Performance  and  Technology  Considerations  in  Wargaming. 

hittoducing  man-in>the<loop  can  mean  accepting  an  uncontrollable  factor  or  "noise"  in 
understanding  technology  tests  and  gaming  evoits.  Patticq>ants  are  seen  as  gaining  experience 
from  the  games,  acting  as  controllers,  or  providing  "real-world"  types  of  errors.  Even  the 
level  of  experioice  that  patticq>ants  have  with  procedures  for  a  particular  game  often  goes 
uncontrolled  and  affects  the  stability  of  play.  A  frequent  assumption  is  that  only  in  closed 
lo(^  simulations  can  human  performance  either  be  eliminated  or  held  constant  as  a  factor. 
A  omtrasting  approach  is  to  incorporate  human  performance  and  related  technologies  directly 
into  our  wargaming  ccmsiderations. 

Currait  war  games  have  a  limited  capacity  to  explicitly  address  human  performance  and  to 
play  technologies  in  areas  heavily  dependent  on  human  capabilities  (e.g.,  C3I,  political/s(x;ial, 
crisis  numagement).  Individual  performance  would  be  very  demanding  to  game  because  of 
tremendous  variability  and  asscKiated  data  storage  detiuuids.  Behavior  of  collectives  (e.g., 
crews,  groups,  teams,  and  units),  however,  is  much  more  stable  than  individual  performance 
and  should  be  a  useful  variable  in  wargaming.  For  example,  wlren  message  traffic  arrives  and 
(nders  are  given  to  units,  their  performance  in  carrying  out  those  orders  can  be  observed. 
Therefore,  die  use  of  umpires  and  observers  becomes  a  part  of  the  requirement  for  studying 
such  performance.  In  ad^tion  to  trying  out  new  technology  ideas  for  C3I,  the  systematic  use 
of  human  petfonnance  should  allow  the  testing  of  special  operations  techniques,  etc. 

Human  performance  and  its  variability  also  needs  to  be  considered  as  an  inportant  factor  in 
trying  out  technologies  with  man-in-the-loop.  Instead  of  allowing  it  to  become  a  "random 
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vnuMe,”  we  could  aim  at  using  it  as  a  key  consideration  in  waigaming,  peiticulady  with 
eaqpectalions  of  a  decreasing  number  of  perstmnel  in  the  active  force.  One  bask  approach  is 
to  at  least  allow  paiticipants  adequate  experience  (i.e.,  practice)  with  a  war  game  so  diat  v^ien 
actual  begins  diere  are  limited  changes  in  their  gaming  proficiency.  In  addition,  we  can 
atdc  udiat  the  ^fects  of  human  perfonnance  variables  are  on  a  game.  For  example,  u^at  are 
the  effects  on  combat  of  woik-rest  cycles,  group  cohesiveness  (Le.,  interactitm  of  personnel, 
rotathm  of  personnel),  perstmnel  quality  (i.e.,  selectitm,  classificaticm,  assignment),  anoount  of 
training,  and  so  on?  Widi  the  current  expense  and  logistics  of  mounting  games,  diis  may  not 
be  reasonable,  but  could  be  a  goal  for  the  future  when  technology  allows  games  to  be 
distributed  and  more  easily  available. 

The  question  is  how  well  gaming  can  handle  the  human  factor.  What  games  currently  are 
availii>le  for  that  purpose?  Do  we  need  new  games?  Or,  is  foere  a  way  that  we  may 
integrate  existing  games  to  more  systematically  incorporate  human  performance  and  related 
technologies.  There  are  a  wide  variety  of  gaming  techniques  to  draw  on  including  interactive 
games  such  as  SIMNET,  ARTBASS,  and  JESS,  other  simulation-based  games,  as  well  as 
tabletop  games,  contrcdled  field  exercises  such  as  National  Training  Center,  and  so  on. 

More  attenticm  needs  to  be  paid  to  human  performance  in  games.  First,  given  that  the  quality 
of  war  games  is  largely  affected  by  die  quality  of  the  partic^ants,  especially  in  one-time  war 
games,  a  hi^  priority  should  be  given  to  ensuring  the  right  mix  of  players.  Second,  since 
observations  and  insights  of  players  are  a  critical  product  of  technology  war  games,  ^lecific 
efforts  need  to  be  made  to  ensure  these  are  collected  and  fed  into  war  game  post  exercise 
analysis.  In  particular,  computer-based  technology  war  games  (such  as  those  based  on 
SIMNET-D)  can  best  be  used  in  conjunction  with  seminar  type  games.  Ideally, 
computer-based  games  would  be  preceded  by  a  seminar  to  define  expectations  and  potential 
in^iacts  of  dififerait  results  and  followed  by  a  seminar  to  obtain  insights  from  players  and  take 
an  aggregate  view  of  the  war  game  process  and  results. 

On  die  technology  side  of  wargaming,  given  the  current  costs  of  developing  computer-based 
war  game  simulations,  in  the  foreseeable  future,  technology  war  games  will  likely  use  existing 
conqniter-based  simulations  as  an  environment  for  technology  assessment.  There  are 
recognized  limits  of  existing  simulations  which  will  limit  the  opportunities  for  technology 
assessments.  It  is  very  important  that  the  ur<derlyjng  algorithms  and  simulation  functionality 
be  well  understood,  because  of  their  impact  on  technology  results.  One  problem  area 
identified  is  the  lack  of  sensitivity  of  many  of  the  current  war  games  to  C^,  an  area  in  which 
technology  nuiy  be  very  s^licable. 

V.  FUTURE  NEEDS  FOR  WARGAMING  TO  SUPPORT  TECHNOLOGY  ASSESSMENT 

The  above  discussion  on  the  limits  and  consideration  of  the  use  of  war  games  for  technology 
gaming  provide  the  basis  for  identifying  the  following  areas  for  in^rovement: 

•  War  games  which  can  be  operated  more  frequently,  flexibly  and  more  cost-effectively 
would  assist  in  the  problem  of  repeating  war  games  for  increased  confidence  in  war 
game  results. 
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•  The  develofMnent  of  a  con^wehensive,  generally  useable  set  of  scenarios  would  aid 
in  assessing  tedmology  concq>ts  in  an  appropriate  range  of  operational  settings. 

•  Better  war  game  simulations  which  more  realistically  represent  the  warfi^iting 
situation,  including  systematically  handling  of  human  pofomunce,  would  provide  a  solid 
environment  for  tedmology  assessmoit. 

VI.  EVOLUnON  OF  THE  WARGAMING  PROCESS  FOR  TECHNOLOGY  ISSUES 
A.  Toward  a  Theory  of  Wargaming. 

1.  War  Games  as  Data.  The  past  history  of  wargaming  is  sudi  that  previous 
effmts,  for  die  most  part,  can  be  treated  as  solitary  data  points  for  whidi  very  little  real 
post-war  game  analysis  has  been  done.  There  is,  in  this  context,  no  theory  of  war.  In  fact, 
because  war  games  are  not  repUcaUe,  thore  ate  many  who  hold  the  opinitm  that  there  can  be 
no  develqxnent  of  a  theory  of  war.  However,  no  matter  how  complex,  real-life  jttocesses, 
including  man’s  decision-making,  follow  the  laws  of  nature  (if  not  {diysics)  and  there  is  no 
reastm  to  not  treat  the  phenomena  of  war  in  a  mediodological  way.  That  is,  as  much  as 
possible,  treat  wargaming  operators,  operands,  and  products  by  the  scientific  mediod. 

It  is  essential  that  the  results  of  war  games  not  be  treated  as  totally  randtnn  events  which 
are  non-replicable,  but  rather  as  valid,  single  data  points  which  are  representative  of  a 
rqieatabte  disttibutitm  of  possible  outctnnes.  It  is  easiest  to  understand  this  in  terms  of 
aggregated  results.  One  can  readily  envision  a  scenario  in  which  side  B  is  so  much  stronger 
than  side  A  that  when  the  scenario  is  war  gamed  side  B  always  wins.  It  is  yet  possible  that 
side  A  may  have  several  units  who,  either  because  of  the  brdliance  of  their  ccmimanders  or 
the  skiU  ai^  experience  of  the  troops,  win  all  of  their  one-on-one  engagements  until  they  are 
overwhelmed  by  either  numbers  or  firepower.  It  is  also  intuitively  clear  that  if  the  war  is 
gamed  a  large  number  of  times  (or  actually  could  occur  in  real  life  at  a  large  number  of 
different  times  in  a  short  period)  that  aldiough  the  overaU  result  would  always  be  the  same, 
the  individual  actions  of  each  and  every  individual  soldier  would  be  different.  Thus,  the 
aggregate  result  (analogous  to  the  pressure  of  a  gas  for  a  given  temperature  and  volume)  is 
always  the  same,  and  aj^arently  independent  of  the  actions  of  the  individual  soldiers  (as  are 
the  thermodyiuunic  properties  of  the  gas  qjparently  independent  of  the  seemingly  random 
motions  of  die  individual  gas  molecules),  liiis  situation  rqiresents  an  extreme  case  seldtmi 
seen  in  real  life  or  in  wargaming,  because  in  real  life  side  A  would  avoid  such  a  war  if  at 
all  possible,  and  in  wargaming  represents  a  very  uninteresting  case.  However,  as  the  relative 
strengths  of  the  combatants  vary  from  diis  extreme  to  equality,  the  probability  of  predicting 
a  specific  outccmie  becomes  exceedingly  small. 

2.  Wargaming  Problems  and  a  Spectrum  of  Solutions.  If  we  are  convinced  that 
an  attenqit  should  be  made  to  treat  wargaming  in  a  more  rigorous  way,  dien  we  need  to  ask 
how  wargaming  problons  can  be  classified  and  how  solutions  to  foose  problems  can  be 
identified.  We  state,  here,  that  wargaming  problems  range  in  a  spectrum  from  ill-defined  to 
weU-dtefined,  and  ccmtend  that  there  is  a  corresponding  spectrum  of  solutions,  the  elements  of 
whidi  are  each  apfdicable  to  a  sub-class  of  ^  conqilete  problem  set.  By  ill-defined,  we 
mean  problems  for  \dudi  parameters  critical  to  the  performance  of  a  given  weqxm  system  are 
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not  wdl  known.  This  pannneter  set  should  be  inteipfeted  in  a  broad  sense  to  include  not  just 
weapon-system  parameters  but  also  operational  parameters.  So  diere  may  be  cases  where 
weapon-^slem  performance  of  a  conceptual  syston  is  reasonatdy  predktaUe  but  the 
operational  context  is  vague,  there  may  be  cases  where  the  performance  characteristics  of 
die  conceptual  system  are  difficult  to  preset  but  the  opoator  (user)  knows  very  well  how  it 
would  be  employed.  Well-defined  problems  are  those  for  which  both  system  performance 
pamneters  and  operational  context  are  well  known. 

CFA  is  qiidkaMe  to  well  defined  problems  where  a  quantitative  analysis  makes  sense,  but 
cannot  cope  widi  problems  that  are  not  well  defined.  It  is  this  type  of  problon  diat  one  is 
faced  widi  trying  to  assess  the  potential  batdefield  utility  of  emerging  technologies. 
For  diese  problems,  TWG  is  not  only  rq^licable  to  but  better  than  traditioiud  analysis.  TWG 
is  more  flexible  md  adaptable:  here,  concepts  become  more  well  defined  and  more  amenable 
to  analysis;  and  questi<His  can  be  answered  in  d^  seminar  format  that  cannot  be  answered  in 
closed  form  such  as  identification  of  issues,  limits  of  applicability  of  systems  relative 
inportance  of  systems,  and  ranges  of  system  parameters.  Only  when  these  questions  are 
resolved  can  more  tradititmal  forms  of  analysis  be  onployed. 

SWG  lies  <m  the  end  of  the  spectrum  of  solutions,  to  TWG  problems,  that  is  applicable  to  die 
Hi-defined  problems  set.  SWG  illuminates  processes  leading  to  better  understanding  of  how 
a  wepem  system  would  be  used,  and  in  fact  can  help  specify  the  performance  characteristics 
die  conceptual  system  will  have  to  have  if  it  is  ever  to  be  fielded.  As  problons  become  better 
defined,  as  either  the  operational  context  becomes  clearer  or  die  system  ctmeept  is  further 
developed,  the  method  of  solution  becomes  more  stroctured.  Thus,  mi  the  one  end  we  have 
SWG;  followed  in  the  spectrum  by  CSWG,  which  allows  much  more  complex  interactions  on 
the  batdefield;  to  highly  structured  gaming  environments  such  as  realized  in  SIMNET-D  and 
other  man-in-the-loop  batde  environments;  through  closed-form  simulations  which  represent 
man-in-die-loop  through  AI  as  we  pproach  traditional  CFA. 

While  this  report  suggests  a  tough  framework  for  developing  a  more  methodological  approach 
to  wargaming,  it  is  clear  that  future  efforts  will  have  to  address  the  establishment  of  criteria 
for  determining  how  ill-  or  well-defined  a  givoi  gaming  problem  is.  A  first  step  would  be 
to  establish  such  criteria  in  terms  of  the  uncertainties  in  parameters  essential  to  a  problem 
solution.  Eventually  there  should  also  be  criteria  described  in  terms  of  those  partial 
differential  equations  which  can  be  used  to  describe  the  time-  and  space-dependence  of 
aggregate  battlefield  parameters. 

B.  Past  Techniques. 

1.  Seminar  Wargaming.  TIG89  was  an  example  of  a  pure  seminar  war  game. 
Its  basic  purpose  was  to  identify  issues  related  to  operational  aspects  of  selected  systems 
b^ond  the  POM  horizon.  The  player  mix  was  about  60%  technologists  (developers)  and  40% 
operational  officers  (users).  Performance  parameters  tradeoffs  were  gamed  in  the  emtext  of 
user  requirements.  The  results  were  expected  to  drive  systems,  scenario,  and  operational 
ctxicqit  assessmoit,  ultimately  leading  to  other  SWG  or  (TSSG  exercises. 
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2.  Computer  Siqiptmed  Seminar  Games.  The  U.  S.  Anny  LABCOM  TBWGl 
was  a  CSWG  involving  cmivemional  warfare  in  Eurt^  in  the  year  2015.  The  mediod 
involved  embedding  notional  systems  in  the  models,  creating  new  units  to  accommodate 
systems  vrUdi  had  no  obvious  jnecursor  in  the  current  force  stracture,  and  having  tech  base 
managers  as  ]dayers  widi  TRADOC  persminel  serving  as  advisors.  The  global  aspects  of  the 
scenario  wore  played  out  with  the  Strategic  Analysis  Simulation  (SAS),  and  operadmud  orders 
that  were  developed  as  part  of  the  play  of  the  game  were  modeled  using  the  Theater  Analysis 
Model  CTAM). 

A  CSWG  was  also  played  at  Natick  Research,  Developntmt,  and  Engine^ing  Center  (NRDEC) 
in  Sqttonber  1989  as  part  of  an  exercise  called  HI-RES89.  This  game  had  a  scenario  similar 
to  TBWGl,  but  etnfduisized  and  was  driven  by  issues  which  either  arose  £n»n  TBWGl  or 
were  particulatly  relevant  to  specific  missions.  TAM  was  used  to  model  at  die  corps  level, 
while  tactical  iMUdes  having  particular  impact  on  certain  systems  woe  played  widi  a  higher 
resolution  table-tr^  model  to  address  specific  tactical  issues. 

3.  Table-Top.  As  stated  above,  higher  resolution  table-top  games  were  also 
played  at  the  HI-RES89  exercise.  Here,  tactical  battles,  which  had  been  identified  in  coarser 
games  as  having  potential  for  significant  intact  on  weqxm-system  batdefield  utility,  were 
played  in  a  higher  resolution  format.  It  is  expected  dial  these  higher  resolution  games  will 
drive  further  analysis  with  closed-form  simulations. 

C.  Current  Techniques  That  Could  be  Applied. 

SIMNET-D  represents  a  current  technology  which  can  contribute  significandy  to  the  overall 
TWG  effort  by  imbedding  humans  directly  into  batdefield  environments  where  they  are 
fighting  a  live  opponent  with  future  systems. 

D.  Future  Techniques  That  Might  Apply. 

In  the  future,  emerging  computer  operating  systems,  and/or  higher  speed  computers  with 
current  operating  systems,  will  allow  multiple,  simultaneous,  isolated  but  identical  presentation 
of  the  same  scenario  to  a  number  of  groups  in  identical  environments,  such  that  a  series  of 
replicatimis  of  the  same  game  can  be  achieved  in  the  same  space  and  expenditure  of  calendar 
days  which  are  now  required  for  only  one  replication.  TIm^  software  controlled  systems, 
when  af^lied  to  multiple  computers  corresponding  automatically  over  a  network,  will  also 
support  die  play  by  some  cells  at  compartmented  levels  of  classification.  The  accrual  of  data 

the  gaming  conqiuters  by  a  corresponding  data  base  system  accessing  the  netwodc  for 
data  will  also  provide  real  time  data  aggregation  and  interim  reporting,  and  a  quick  preparation 
of  the  final  report  (which  are  not  frequendy  prepared  today).  The  issue  for  MORS  is  dial 
we  must  assert  that  this  type  of  operating  system  and  network  system  integration  must  be 
acccmiplished  to  benefit  the  analyst  community  by  the  services  which  develt^  war  games. 
When  this  is  done,  we  will  be  able  to  gain  full  appreciation  of  the  advantages  which  computer 
assisted  wargaming  can  bring  to  the  decision  maker. 
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Vn.  INSIGHTS,  PERSPECTIVES,  AND  CONCLUSIONS 


A.  Connderations  in  Designing  Technology  War  Games. 

Althou^  diere  should  not  be  a  "cookbodc"  for  the  creatitm  of  technology  war  games,  it  has 
become  apparent  that  some  very  key  factors  are  often  ovedocdced.*’  Hmce,  the  following 
discussion  is  designed  to  assist  the  specialist  in  gaming  and  simulations  when  considering  a 
task  to  create  a  technology  war  game. 

1.  The  scenario  and  war  game  must  be  dependent  iqxm  die  overall  purpose  of  the 
exercise.  As  has  been  discussed  eariier,  wlwtlMr  or  not  a  game  or  simulation  is  being  played 
out  in  support  of  research  and  analysis,  consensus  building,  or  educatitm  die  purpose  of  die 
exercise  will  have  a  major  and  first  order  impact  on  the  game. 

If  a  game  is  designed  to  validate  or  perform  sensitivity  analysis  <mi  a  previous  game  or 
analysis,  diere  will  be  major  constraints  on  the  scmario.  The  scenario,  in  such  a  case,  would 
have  to  be  identical  to  the  one  used  in  the  original  game  or  analysis.  The  control  team  from 
the  first  game  would  have  had  to  keep  close  watch  on  the  contact  of  that  game  in  order  to 
detect  and  record  in-game  modifications  to  the  scenario.  Obviously,  artificial  intelligence-like 
systems  will  automatically  record  the  full  scenario  making  this  task  easier. 

The  potential  sponsor  of  a  game  is  faced  with  dw  dilemma  of  knowing  when  he  has  an 
appropriate  question  that  warrants  investigation  by  wargaming.  Such  a  dilenuna  supposes  that 
it  is  possible  to  fiiUy  predict  the  output  of  a  game  prior  to  its  constract.  If  the  purpose  of 
the  game  is  for  consensus  building  or  education,  then  the  a]^ropriate  question  is  simply  when 
does  the  sponsor  feel  that  such  a  process  is  needed. 

If  technology  wargaming  is  to  be  used  for  research,  then  it  is  likely  that  the  sponsor  will  not 
know  when  he  has  an  iqtpropriate  question,  i.e.,  it  might  be  better  to  have  an  cm-going  series 
of  games  scheduled  which  by  dieir  very  nature  are  exploratory  in  nature.  With  exploratory 
games,  the  questitms  ought  not  arise  until  during  or  even  after  the  game. 

2.  The  players  themselves  will  significandy  influence  the  game.  In  a  game 
designed  for  the  purpose  of  consensus  building  or  support  of  an  already  existing  procurement, 
the  scemuio  could  be  very  brief  and  the  game  quite  stractured  since  the  players  are  likely  to 
be  already  familiar  with  the  issues  being  gamed.  On  the  other  hand,  if  one  seeks  the 
pa]ticq>ati<m  of  chief  scientists,  techitical  experts,  branch  and  department  heads  in  a  war  game 
designed  to  explore  a  range  of  alternative  futures,  the  scenarios  will  most  likely  be  very 
heavily  oriented  for  major  policy  questions  and  the  game  may  need  to  be  fieewheeling  to 
explore  the  full  range  of  options.  Macro  analysis  versus  micro  analysis  as  the  purpose  during 
the  game  will  result  in  vasdy  different  scenarios  and  games.  A  macro  approach  war  game 
for  flag  and  general  officers  might  require  a  scenario  with  significant  enqdiasis  on  political 
context.  The  same  scenario  when  used  for  a  group  of  techrucal  experts  might  not  wori:  at  all. 

Technology  wargaming,  like  other  forms  of  wargaming,  cannot  be  done  without  the 
participation  of  expats  in  the  areas.  Technology  wargaming  will  require  seiuor  technology 
marugers  to  make  dieir  chief  scientists  available  for  such  exercises.  Managers  and  their  senior 


43 


ftoffiB  will  also  be  required  to  spoid  the  time  necessary  with  the  scenario  builders  and  game 
designers  so  dut  the  game  will  meet  their  expectations.  Post  gariM  analysis  will  also  require 
their  time  and  energy.  Senior  individuals  will  need  to  give  time  to  analysts  who  are 
attenqrting  to  perform  their  task.  Without  arch  commitments  of  time  from  key  decision 
makers,  there  is  no  real  point  in  undertaking  the  efrort. 

3.  The  available  game  time  significantly  influences  the  scenario  that  can  be 
played.  Global  war  games  at  the  Naval  War  College  that  last  weeks  can  go  into  much  more 
depdi  dian  a  half-day  or  one-day  game  held  in  Washington  by  participants  who  are  oftoi 
answering  {durne  calls  while  engaged  in  the  play.  This  is  not  to  say  diat  the  long  game  is 
necessarfly  supoior  to  tiie  short  simulation;  that  judgment  depends  on  a  number  of  factors;  it 
is  only  to  say  that  the  scenario  depends  upon  how  long  one  can  play. 

One  can  attenqit  to  increase  the  depth  of  the  ^ort  game  scoiario  by  asking  participants  to 
read  it  prior  to  the  game.  This  may  not  work  for  the  busy  participant  and  may  not  even  be 
worth  die  efforts.  Naturally  if  a  scenario  contains  proprietary  or  classified  material,  the 
requirements  to  safeguard  such  material  and  account  for  transit  time  may  preclude  this  option. 

4.  The  sponsor  of  a  game  is  a  major  variable  in  setting  a  scenario.  If  the  ^nsor 
desires  to  use  the  game  to  assist  in  the  exploration  in  the  war  fighting  opportunities  afrorded 
by  emerging  technologies,  then  a  game  that  actually  focuses  on  arms  control  for  those 
technologies  is  totally  out  of  place.  Similarly,  one  would  expect  that  if  an  agency  sponsored 
a  game,  then  the  designers  of  the  game  and  scenario  would  be  either  specifically  or  indireedy 
influenced  by  that  agencies  current  or  future  programs  and  preferred  strategies. 

5.  The  scenario  also  depends  upon  the  time  and  setting  of  the  game,  i.c.,  what 
period  of  time  the  sponsor  desires  game  and  where  the  game  is  to  be  played.  Time  is  a 
frequendy  mishandled  variable.  Whereas  scenarios  for  present  day  games  may  be  more  easily 
created,  the  formulation  of  future  scenarios  challenges  even  the  best  politick  scientist.  Yet 
precisely  for  this  reason,  games,  simidations,  and  scenarios  planning  are  powerful  tools  to  help 
analysts  gain  insight  into  the  future. 

Even  relaying  historical  events  with  variations  can  challenge  historians  to  create  an  artificial 
environment  of  what  might  have  been.  Historical  scenarios  can  be  surrogates  for  present  day 
situations  that  are  otherwise  awkward  to  handle.  A  good  example  of  this  is  the  Soviet  military 
method  of  using  historical  scenarios  to  make  points  about  questions  of  current  doctrine, 
strategy,  irrational  art  and  tactics  in  an  Aesopian  web  that  sub^itute  historical  case  study  for 
the  present  or  antierted  future.  Where  historians  can  identify  analogous  situations, 
technology  games  might  be  used  to  help  managers  illuminate  what  will  be  necessary  to 
transition  to  die  new  environment. 

The  physical  location  of  a  game  is  also  a  major,  but  often  overlooked,  factor  in  setting  a 
scenario.  Exercises  that  cannot  accommodate  proprietary  or  classified  material  will  require 
only  unclassified  scenarios  and  data  bases.  Facilities  that  limit  the  number  of  players  or  that 
do  not  have  die  use  of  modem  artificial  intelligence-like  support  systems  or  other  computers 
aids  will  result  in  less  sophisticated  scenarios  than  these  which  have  these  advantages.  The 
obvious  problem  here  involves  playing  systems  that  require  special  compartmented  information. 
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6.  The  handling  of  classified  and  proprietary  information  can  generally  be  handled 
by  having  an  "off-line"  group  with  appropriate  access  to  agree  on  tte  major  issues  that  need 
to  be  addreraed  in  the  game  and  then  by  treating  the  infonruttion  parametrically  at  a  lower 
level  of  classification  or  on  a  nonattribution  basis.  The  alternative  to  this  method  is  to  ignore 
informatim  that  might  be  cmcial  to  the  play  of  a  game  with  players  diat  are  known  for  dreir 
abilities  to  contribute  in  such  an  enviromnent.  In  the  area  of  tet^ology  gaming,  goverrunent 
and  industry  intelligence  agencies  are  going  to  have  to  come  to  a  common  understanding  of 
the  need  to  share  sources  and  methods  as  well  as  the  basic  infomuition  itself. 

7.  The  communication  of  the  results  of  technology  wargaming  have  the  same 
requiremaits  as  do  the  results  of  formal  analysis.  There  will  be  some  recipients  that  will 
desire  detailed  and  in-depth  knowledge  of  die  gaming  experience,  but  it  is  more  appropriate 
to  make  explicit  the  assumptions  under  which  die  game  was  constructed,  simply  give  a  cursory 
explanation  of  the  play  of  the  game,  and  concentrate  on  the  insights  that  were  gained  with 
qipropriate  caveats. 

B.  Issues/Insights. 

1.  Reservations  on  Use  of  Gaming.  Neither  simulations  nor  games  are  a  substitute 
for  reality  nor  a  method  of  analysis,  but  such  new  techniques  afford  us  a  tool  to  investigate 
alternate  futures  and  thereby  assist  analysts  in  assessing  their  impact.  In  other  words,  given 
a  set  of  "what  if'  political,  military,  or  economic  conditions,  modem  gaming  techniques  can 
help  government  and  businesses  explore  alternative  futures  that  they  might  have  to  deal  with. 

Although  the  advantages  and  opportunities  of  new  gaming  techniques  ate  beginning  to  be 
qrpteciated,  enormous  caution  must  be  exercised  in  their  use.  Tlie  modeling  community 
cannot  allow  its  sponsors  to  think  that  scenarios  generated  by  gaming  or  simulation  lessons 
and  insights  that  result  from  the  manpulation  of  software  or  machines  are  any  more 
"scientific"  or  "important"  than  those  gained  firom  any  simulation  technique. 

Scenarios  for  technology  war  games  do  not  need  to  be  as  detailed  as  one  might  imagine.  For 
example,  if  a  game  starts  with  the  current  world  conditions  "as  is,"  a  detailed  state  of  the 
world  or  major  intelligence  briefing  is  probably  not  required  for  the  players.  Control, 
however,  needs  to  have  vast  amounts  of  background  material.  New  advances  in  computer  aids 
or  in  artificial  intelligence  will  gready  assist  both  players  and  control  in  keeping  track  of 
scenario  state. 

Unfortunately,  there  is  no  simple  answer  to  the  question  of  how  detailed  and  complex  a 
scenario  or  technology  war  game  must  be.  A  large  complex  scenario  might  turn  off  senior 
players  who  simply  do  not  have  the  time  to  be  brought  up  to  speed  for  a  temporary  exercise. 
Siri^ariy,  an  excmciatingly  detailed  scenario  might  so  stifle  the  players  that  a  creative 
intellectual  environment  catmot  be  achieved. 

Good  war  games  can  assist  ^nsors  in  illuminating  differences  in  perceptions,  different 
concepts  of  operations,  and  to  make  concrete  certain  difficult  to  understand  abstract  concepts. 
As  such,  games  and  their  supporting  scenarios  become  one  more  tool  for  research,  consensus 
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building,  and  education.  Wargaming  can  also  result  in  a  checklist  of  actitMis  to  be  considered 
during  real  operaticms. 

Scenarios  creation  in  fact  can  be  so  important  to  the  gaming  and  simulation  process  that  a 
case  can  be  made  that  the  input  phase  of  the  game  might  even  yield  a  higher  pay  off  to  die 
sponsor  than  will  the  results,  lessons  learned,  and  other  out-puts.  The  process  of  extracting 
the  insights  from  the  creation  of  a  game,  or  its  conduct,  is  an  extrenrely  difficult  and  time 
consuming  process;  one  which  takes  longer  than  most  ^nsors  are  willing  to  allow. 

The  measure  of  effectiveness  for  a  good  technology  war  game  is  whether  or  not  it  helped  the 
particqiants  and  control  do  something  else  satisfactorily.  If  more  time  is  spent  explaining  or 
discussing  the  scenario  or  adjudication  mechanics  than  on  the  issues  diat  the  game  is  designed 
to  explore,  dien  the  game  was  probably  not  worth  the  effort.  Good  analysis  can  probably 
overcome  the  deficiencies  of  a  bad  scenario  or  game,  but  a  good  scenario  by  itself  does  not 
ensure  a  good  game.'^ 

We  cannot  afford  to  look  only  at  single  scenarios.  Rather,  a  wide  variety  of  scmarios  should 
be  examined  as  a  sensitivity  or  contingency  test,  i.e.,  if  findings  hold  up  regardless  of  the 
scenario,  then  we  can  feel  more  confident  about  them.  To  only  game  a  single  scenario  invites 
the  type  of  myopia  that  lead  to  over  reliance  by  the  French  on  its  Maginot  Line  or  on 
strategic  bombing  as  a  deterrent  by  the  British  before  World  War  n. 

2.  Cost.  A  major  problem  in  wargaming  in  general  and  technology  gaming  in 
particular  is  the  manpower  cost  of  man-in-the-loop  simulation  as  it  affects  the  desire  to 
replicate  the  experiment,  holding  as  many  input  variables  constant  as  possible.  Cleady,  one 
of  those  problems  is  the  desire  to  ensure  that  the  high  level  decision  makers  and  technologists 
(crucial  players)  can  be  available  for  one,  a  few  or  many  replications.  Leadership  issues  are 
so  inqwrtant  that  any  surrogate,  acting  in  a  decision  role,  caiuiot  have  the  impact  of  his 
mentor.  The  mitigating  factor,  in  using  a  war  game  to  create  the  appropriate  enviroiunent 
for  decision  making,  is  that  the  war  game  costs  less  in  every  other  measurable  dimension  than 
a  full  scale  exercise,  and  gets  closer  to  presenting  a  full  spectrum  of  important  issues  than 
does  any  other  form  of  analysis  method.  So  the  total  cost  of  the  analysis  is  lower  and  the 
results  are  near  to  real  world  results,  even  though  the  manpower  cost  is  high. 

Corollary:  Whatever  the  level  of  fidelity  is  for  the  model  being  used  to  represent  the 
technology  of  interest  in  the  war  game  (and  there  is  always  a  model,  even  in  a  seminar  game 
which  is  not  coirqruter  supported),  the  best  means  of  insuring  meaningful  results  from  the  war 
game  (even  if  negative)  is  to  adhere  to  excellent  princ4>les  for  the  design  of  the  experiment 
in  the  pre-plaiming  stage.  These  design  principles  are; 

•  Clear  statement  of  one,  or  a  very  few  complementary,  objective(s), 

•  Selection  of  an  accepted  method  of  analysis  of  the  results  of  the  gaming  which  fits 
the  expected  number  of  replications  of  the  war  game  which  can  be  afforded, 

•  Qose  investigation  of  the  number  of  output  variables  and  form  of  the  data  which  can 
be  analyzed, 

•  Iteration  of  the  top  three  topics  above  to  set  the  design. 
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•  Augmentation  of  the  control  team  witfi  ^)ecially  trained  observers  who  collect  data 
on  human  bduvior  and  recognition  acuity  of  players  responding  to  stimuli  whidi  are 
controlled  by  the  un^iies  (this  is  an  ack^  manpower  cost  which  pays  big  dividends 
in  data  for  all  disc^lines), 

•  Training  of  the  players  to  reduce  noise  normally  injected  by  lack  of  an  accq)Cably 
high  comimm  knowledge  of: 

-  basic  infoimation  which  applies  to  the  technology  being  investigated, 

-  current  q>plicable  tactics, 

-  threat  information, 

-  hardware  interface  considerations  (if  ipplicable),  and 

•  Tight  sdieduling  of  sessitms  to  facilitate  positive  group  dynamics  and  avoid  loss  of 
learning  in  players. 
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own  efforts  are  designed  to  expand  upon  his  suggestitms. 
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APPENDIX  C 

SYSTEMS  ACQUISITION  GROUP  REPORT 


I.  INTRODUCTION  OF  WARGAMING  AS  APPLIED  TO  SYSTEMS  ACQUISITION 
A.  Defimtions  and  Background. 

Waigaming  has  be«i  defined  in  many  ways.  Dr.  Peter  Peria  states  that,  in  the  broadest  sense, 
waigaming  is  warfare  modeling,  including  simulations,  canqpaign  and  systems  analyses,  and 
militaiy  exercises.  Further,  it  is  an  exercise  in  human  interaction.  He  restricts  wargaming’s 
definition  excluding  analysis  which  uses  rigorous,  quantitative  dissection  and  submits  tiiat 
wargaming  is  not  real  or  duplicatable. 

In  bounding  its  area  of  focus,  the  Wessons  Acquisition  and  Manfwwer  Planning  Group  chose 
to  look  at  war  games  from  the  perspective  of  warfare  modeling,  including  simulation  and 
campaign/systems  analysis  but  excluding  exercises,  and  we  restricted  ourselves  to  only  those 
"games"  diat  included  a  man-in>the-loop. 

Although  evaluating  both  acquisition  and  mai^wer,  we  concentrated  on  the  acquisition 
process  and  restricted  our  treatment  of  manpower  to  only  those  cases  in  which  manpower  was 
integral  to  a  given  system  or  subsystem,  including  logistics/maiqwwer  requirements,  etc.  Odier 
areas  of  manpower  such  as  demographics  were  considered  feasible  to  war  game  but  were  not 
addressed  in  depth.  System,  were  therefore  defined  to  include  equipment,  manpower, 
personnel  and  training  (MPT),  and  logistics.  Consistent  with  this  approach  we  ^opted 
Systems  Acquisition  as  our  group  title. 

Systems  acquisition  was  viewed  to  include  both  the  domain  of  traditional  systems  procurement 
as  well  as  the  broader  realm  of  Mission  Area/Develoinnent  Analysis.  Mission  Area/ 
Development  Analysis  included  the  following  steps: 

1.  Mission  areas  ate  conceived/hypothesized  by  means  of  requirements/force 
stracture  conq>arison. 

2.  Analysis  of  tactics,  training,  and  systons  concepts  are  performed. 

3.  Trade-off  candidates  ate  formulated/conceived. 

Once  trade-offs  are  evaluated,  the  formal  acquisition  process  starts  and  a  system  moves 
through  milestones  0  to  4  (see  Figure  C-1).  But  this  process  is  part  of  a  bigger  picture.  At 
one  extreme,  major  ii:q)uts  are  National  and  Service  Strategies  that  stem  from  Natioiud 
Ob^  actives.  At  tiie  other,  the  process  is  not  single  pass,  but  is  constantly  in  feedback  as 
existing  systems  are  matched  against  current  requirements  to  determine  new  developmental 
efforts  to  be  pursued. 

Witiiin  the  acquisition  process,  technology  war  games  will  probably  be  vital  in  formulating 
tactical,  training,  and  system  solutions,  while  Test  and  Evaluation  war  games  are  expected  to 
interface  throughout  milestones  zero  to  four. 
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Figure  C-1.  System  Acquisition. 


B.  Reasons  for  Using  War  Games  in  Systems  Acquisition. 

In  Ac  System  Acquisition  process,  die  idoitification  of  combat  and  wetpon  ssrstems 
deficiencies  and  the  deveit^iment  of  potential  solutions  have  derived  from  a  wide  range  of 
hqwts;  from  operational  commanders’  requirements  and  i»ioiities  to  die  outcmne  of  exercises, 
war  games,  or  odier  analytic  tools. 

War  games,  dierefore,  have  always  had  a  niche  in  the  requirements  analysis  process  and  in 
die  formulation  of  conceptual  soluticms  to  problems.  The  growth  of  computer  technology, 
including  the  development  of  advanced  grs^cs  cipabilities,  has  allowed  even  Inoader  use 
(Le.,  more  detail  and  more  scope)  of  war  games. 

These  technological  advances  now  offer  die  jno^iect  diat  die  traditional  role  of  waigaming 
(Le.,  die  exposure  of  humans  to  die  warfighting  decisitm  process  in  order  to  gain  insights  into 
die  way  wars  are  planned  and  fought)  can  be  expanded  to  peimit  coupling  of  humans  wtdi 
actual  or  breadboud  systems  in  a  simulated  combat  envircmment  for  assessing  system 
petfonnaiKe  and  effectiveness.  Hiis  allows  more  in-depth  (Le.,  b^ter)  examination  of  ssrstems 
cmicqpcs  brou^  forward  for  acquisition  and  develcqmient  because  real  humans  can  replace 
closed  foim  representations  of  human  acticm,  represented  in  die  past  solely  by  simulaticKis. 

This  is  not  to  say  diat  "wargaming"  as  defined  in  this  paragtiqdi  (Le.,  "men-in-die-loop") 
should  or  could  replace  analytical  simulations.  Radier,  it  inqilies  an  increased  opability  to 
study  die  man-^nadiine  intetfoce  during  systems  acquisiticm.  The  critical  role  of  humans  in 
systm  operation  and  performance  dictates  that  diis  ctnnbination  be  examined.  Thoe  is 
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growing  aqMiience  in  including  luunans  in  the  evaluadtm  process.  Manned  flight  sinailations, 
for  eaunnide,  are  used  during  system  develc^xnent  in  order  to  evaluate  design  options  and 
emidoynient  concepts.  These  same  simulatkms,  updated  cmitinually  during  development,  dien 
are  used  to  evaluate  potential  P3I  inprovonents  as  part  of  die  acquisititm  process. 

This  experience,  coupled  widi  die  wargaming’s  traditional  value  in  developing  insights,  offers 
the  prospect  that  development  and  deployment  in  the  system  acquisititni  process  can  give  far 
better  ctMisideratimi  to  human  inqiact  on  system  operadtni  and  perfoimance  avoiding  pndiibitive 
e:q)en8es  normally  associated  with  prototyping. 

Man-in-die-loq>  simulations  used  in  a  war  game  oivironment  (i.e.,  a  scenario  with  objectives, 
assumptimis,  threat,  players,  etc.)  can  access  a  greater  range  of  conditions  and  interacticms  than 
can  be  executed  in  most  closed  form  simulations.  This  may  or  may  not  be  desired  and  care 
must  be  taken,  but  the  potential  is  there. 

Classically,  man-in-the-loop  simulations  such  as  simulators  and  test  beds  may  not  have  beoi 
considered  "war  games".  That  may  still  be  iiuqipropriate.  Even  so,  the  involvement  of 
humans  tolerating  systems  as  part  of  the  assessment  process  in  ^sterns  acquisititm  is  an 
inevitable  inoirovement.  The  coupling  of  many  or  several  man-in-the-loop  simulations  against 
a  dynamic  threat  offers  increased  flexibility  and  greater  breadth  than  in  the  past. 

The  essential  reason  why  "war  games"  should  be  used  in  the  acquisition  process  is  that  they 
are  unique  means  of  studying  humans/systons  interrelationsh^.  In  a  properly  designed 
experiment,  war  games  may  be  the  best  tool  for  the  task. 

n.  PAST  APPLICATIONS  OF  WARGAMING  TO  SYSTEMS  ACQUISITION 

A.  Specific  Examples. 

1.  GLOBAL.  This  game,  conducted  at  NWC,  and  other  similar  games  were  used 
to  define  the  Navy’s  Maritime  Strategy.  With  a  strategy,  the  Navy’s  acquisition  process  has 
been  more  focused.  The  community  perception  is  all  in  terms  of  its  support.  By  relating 
back  to  strategy,  the  acquisition  process  is  more  successful  in  clearly  demonstrating  needs. 

2.  Navy  POM.  This  research  game,  conducted  aruiuaUy  since  1984,  is  designed 
to  examine  specific  aspects  of  the  Navy’s  proposed  POM.  This  game  is  manned  by  players 
from  Navy  coti^nent  commander  staffs  and  rqiresentatives  from  the  Office  of  die  C^ef  of 
Naval  Operations.  It  exercises  selected  weapon  systems  in  hypothetical  operational  settings 
to  gain  insights  diat  assist  in  sui^rting  decisions  and  clarifying  needs.  Threat  develtqnnents 
are  stressed.  The  ctqiability  to  exercise  a  full  range  of  options  is  limited,  due  in  part  to  lack 
of  tools  (assessment  methods)  and  data  to  suj^rt  a  seminar  format  and  "all"  the  POM 
systems.  The  community  rqrpears  to  support  a  seminar  format,  but  is  wary  of  the  potential 
misuse  of  estimated  outcomes  (required  for  game  play,  but  not  necessary  supported  by 
independent  analysis)  and  of  the  la^  of  visibility  for  specific  systems  ("They  don’t  play"). 

3.  Tabletop.  The  Army  developed  and  used  several  tabletop  war  games  for  both 
systems  acquisition  analysis  and  training  in  the  1970s  and  early  1980s.  In  general,  these 
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games  were  computer-assisted  to  pofoim  battle  damage  assessment,  maintain  unit  status  and 
locatkxtt,  and  recoid  all  game  events  for  later  evaluatkm.  The  use  of  diese  war  games  for 
analysis  has  gradually  been  replaced  by  closed-foim  simulations  as  pait  of  die  Army  Model 
Inqinovement  Program. 

An  example  of  a  tabletop  war  game  used  for  analysis  of  weqxin  systons  acquisiti<m  was 
developed  at  die  Army  Infantiy  School  in  1978-79.  Close-in  Infantiy  Batde  (CIB)  was 
developed  to  analyze  force  structure  issues  about  the  Bradley  Fighting  Vehicle  (B!^  (IX)EA 
at  milestone  n.  No  odier  tools  were  available  to  analyze  the  value  of  an  individual 
dismounted  infantryman  as  part  of  mechanized  cmnbat.  In  four  mondis  finmi  initial  tasking, 
a  conqdete  game  methodology,  data  base,  lesoutces  (terrain  and  unit  represoitadon),  and 
training  program  were  developed.  Although  the  development  was  acconqilished  in-house,  it 
was  influenced  by  commercial  war  game  methodology.  Solutions  to  many  war  game 
"tedinology”  problems  were  innovated  in  the  process.  A  "squashed  hexagonal"  grid  was 
printed  over  photognqdiicaUy  enlarged  militaiy  m^,  and  cardboard  counters  constructed  to 
rqnesent  soldiers,  weqions  and  equqmient.  Weapons  effects,  acquisition  and  movement  data, 
onnpatible  with  current  analytical  simulation  data,  was  tabulated  for  player  use.  Tables  of 
"random"  numbers  were  prepared  to  save  time  rolling  dice.  Play  was  time  sequoiced  and 
alternated  between  Red  and  Blue  with  separate  movement  and  acquisition^iring  phases. 
Approximately  SO  infantry  and  armor  Captains  finishing  the  Infantry  Officer  Career  Course 
were  trained  (one  week)  as  Blue  or  Red  players.  Special  efforts  were  made  to  enhance  the 
aiudytical  value  of  the  results,  including:  a  detailed  operations  provided  uniform  initial  and 
boundary  cmiditions;  player  and  controller  training  stressed  the  analytical  objectives  of  the 
results  and  de-emphasized  the  value  of  individuals  "winning;"  and  controllers  and  die  Control 
Group  closely  monitored  play  to  prevent  "abnormal"  play.  Five  simultaneous  games  were 
conducted  on  the  same  scenario.  Each  group  played  five  different  scenarios  in  sequence, 
each  lasting  one  week.  All  movement,  acquisition,  and  firing  data  was  saved  manually  by 
oilisted  assistants  and  used  in  the  subsequent  analysis  which  compared  MOE  from  each 
scenario.  Results,  including  recommended  infantry  squad  size,  were  presented  in  the  BFV 
COEA  decision  brief  and  in  reports  to  the  Army  and  Defense  Acquisition  Review  Councils. 

4.  Man-in-the-loop  Simulators.  Historically,  man-in-the-loop  simulators  have  not 
been  considered  war  games.  However,  consistent  widi  the  broad  definition  of  "war  game" 
that  has  been  adopted  for  this  workshop,  they  represent  critical  tools  for  enhancing  the 
acquisition  of  systems. 

This  set  of  tools  can  be  subdivided  into  four,  progressively  more  complex,  classes  of  tools: 

•  nqrk)  prototypes  that  use  conunnrcially  available  (e.g.,  Bricklin  demonstration  package 
or  hypercard)  or  customized  software  to  generate  operator  displays  that  are  candidates 
for  the  evolving  system.  There  is  generally  little  attempt  to  employ  or  generate  hardware 
or  software  diat  would  actually  go  into  the  system. 

•  narrow  ^stem  evaluation  tools  that  emulate  selected  elements  of  die  actual  system 
(e.g.,  its  man-machine  interface). 
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•  full  system  simulators  that  cq)ture  all  significant  features  of  a  syston  (although 
generally  excluding  propulsiim). 

•  ^stem-of-syston  simulators  that  internet  individual  simulated  and  real  systems  to 
c^Huie  dieir  operadtmal  interactions.  In  several  prior  activities,  these  have  included  the 
internetting  of  bodi  weiqxxi  systems  and  their  associated  command  and  control. 

The  following  discussion  briefly  gives  some  exan^les  of  each  of  these  classes  and  their 
apfdicatkms. 


a.  R{q>id  Prototypes.  In  die  WWMCCS  ADP  Modernization  (WAM),  nqiid 
prototyping  was  used  to  clarify  tlM  kind  and  format  of  information  that  the  user  needed  to 
perform  his  assigned  functions.  The  Bricklin  demonstration  package  (extremely  inexpensive 
and  used  on  an  IBM  PC)  generated,  stored,  and  retrieved  alternative  system  di^lays.  After 
running  a  series  of  experiments  with  a  group  of  operators,  agreement  was  reached  on  a  subset 
of  system  specifications. 

b.  Narrow  System  Evaluation  Tools.  In  the  Advanced  Emergency  Action 
Message  Processing  and  Di^lay  System  (AEPDS),  a  narrow  system  evaluation  tool  was  built, 
and  it  evolved  to  assist  in  acquisition  of  the  system.  The  tool  focused  on  the  man-machine 
interface  and  was  used  to  explore  alternative  m«:hanisms  for  operators  to  input  and  transmit 
data.  In  the  program,  data  for  sets  of  operators  were  collected  to  quantify  and  conqrare 
critical  measures  of  performance  (e.g.,  probability  of  correctly  composing  a  message,  time  to 
compose  and  transmit  a  message). 

c.  Full  System  Simulators.  There  are  a  large  number  of  system  simulators 
that  have  been  built  and  employed  to  assist  in  the  development  of  and  training  on  weapons 
and  systems.  Since  the  acquisition  costs  of  many  systems  are  becoming  so  large  (particularly 
for  major  weqrons  systems  such  as  the  Advanced  Tactical  Fighter  or  an  Aegis  weapons 
system),  these  test-be^  are  being  created  and  employed  at  progressively  earlier  stages  in  the 
acquisition  process.  An  example  of  an  iruiovative  ^rplication  of  a  full  system  simulator  to 
acquisition  is  the  F/A-18  suigle-seat  versus  dual-seat  crew  simulation  that  was  reported  in 
the  1989  Rist  Prize- winning  prq>er. 

d.  Systems-of-systems  Man-in-the-loop  Simulators.  Over  the  past  decade, 
a  series  of  systems-of-systems  simulators  has  emerged  to  support  a  variety  of  objectives. 
These  objectives  include  inter-operability  assurance,  training,  systems  evaluation,  and  systems 
acquisition.  Selected  examples  ate  cited  below. 

(1)  Inter-operability.  One  of  the  Erst  attempts  to  employ  simulators 
to  assure  inter-operability  was  the  Tactical  Air  Control  System/Tactical  Air  Defense  System 
(TAC^A'ADS)  test-bed.  This  geographically  distributed  systrai  intemetted  both  mission 
simulators  (e.g.,  E-3A)  and  real  tactical  systems  (e.g.,  TSQ-73,  NTDS,  ATDS,  TSQ-91). 

(2)  Training.  One  of  the  latest  efforts  has  been  the  DARPA-sponsored 
SIMNET  program.  (Note  this  program  has  both  a  training  and  research  component.)  SIMNET 
includes  large  numbers  of  simulated  heterogeneous  units  (i.e.,  tanks,  IFVs,  helicopters,  Exed 
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wing  aircraft,  nx>bile  units),  a  comnKm  peicepdrai  of  the  battlefield,  and  siqjport  for  interactive 
waigaming. 

(3)  Systons  Evaluaticm.  In  the  eariy-to-mid  19808,  DTE  (OSD) 
siqipotted  die  acquisition  of  die  Identificaticxi,  Friend,  Foe  or  Neutral  (IFFN)  test-bed  as  a 
means  finr  evaluating  die  performance  of  air  defense  system  mixes  (e.g.,  PATRIOT,  IHAWK, 
F-IS)  and  associated  0  systaxa  (e.g.,  TS(^73,  E-3A).  The  test-bed  has  beat  used  to  assess 
system  performance  (e.g.,  fratricide)  in  a  simulated  conflict  in  the  Coitral  Region  of  Europe. 
The  test-bed  transititmed  to  TAWC,  USAF,  and  was  renamed  the  Tactical  Air  Simulatirai 
Facility  (TACX)SF).  ft  is  expected  to  {day  a  significant  role  in  refining  requirements  aid 
speci&aritMis  for  the  evolving  NATO  Air  system. 

(4)  Systems  Acquisition.  As  a  bounding  illustraritm  for  use  of 
intemetted  simulators,  the  McDonnell  Douglas  Air  Combat  Simulator  (MACS)  was  used  to 
assess  operaritmal  utility  of  die  Advanced  Medium  Range  Air-to-Air  Missile  (AMRAAM)  in 
M-on-N  tactical  air  engagements.  At  the  other  extreme,  SDIO  is  develqiing  a  distributed 
Natitmal  Test-bed  (NTB)  to  support  all  jdiases  of  acquisiticMi  for  strategic  defense  against 
ballistic  missiles. 

B.  Problems  and  Limitations. 

Based  on  prior  experience  with  war  games,  there  is  considerable  understanding  of  their 
problems/limitations.  A  partial  listing  includes: 

1.  Resource  Requirements.  Most  of  these  tools  are  extremely  resource  intensive. 
Broad  conceptual  war  games  tend  to  be  very  manpower  intensive  and  require  experts,  while 
conqilex  man-in-the-lo<^  mission  simulators  are  acquisitions  in  their  own  right  (e.g.,  may  take 
years  to  develop,  cost  tens  of  millions  of  dollars,  and  require  strong  commitment  for 
sustenance  and  modification). 

2.  Credibility.  Historically,  the  credibility  of  these  tools  has  been  held  in  question 
(particularly  by  individuals  whose  preconceived  opirtions  are  not  supported). 

3.  Internetting.  There  is  a  trendrinterest  towards  increasing  internetting  of  war 
games.  However,  community  standardsrinterfaces  remain  to  be  developed  and  promulgated  to 
stqrport  this  objective. 

4.  Experimental  ^sign.  There  is  need  for  efficient  experimental  designs  ^Hat 
mitigateridentify  potential  bv^^^s  in  results  (e.g.,  operator/player  learning). 

5.  Evolvability.  Many  of  the  existing  war  games  are  very  cumbersome.  This 
suggests  the  need  for  modular  architectures  to  facilitate  evolution. 

6.  Acquisition.  War  games  are  generally  large  and  complex,  mandating  sound 
systems  engineering  princ^les.  Present  war  games  tend  to  be  poorly  documented,  lack 
configuration  management,  and  manifest  "spaghetti  code". 
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C.  Conmninity  Percq)ti(ms. 

Tiaditional  war  games  have  been  characterized  dieir  broad  or  concq>tual  qjproach  to 
proUems  and  the  qualitarive  nature  of  their  results.  In  the  system  acquisition  process,  they 
have  provided  strategic  setting,  operationai  context  and  tactical  detail  for  needs  analysis  and 
letpiiiements  definitim,  and  have  provided  insights  and  guidance  in  such  areas  as  doctrine, 
scenario  development,  force  structure,  issues  identificati<Mi  and  c<xis«isus  building.  These 
traditional  approaches,  with  their  well-established  foundations,  have  played  an  inqwitant  role, 
but  they  have  not  met  the  quantitative  needs  of  designers  and  systems  engineers  in  defining 
concepts  and  evaluating  ttadeofEs. 

There  is  a  new  con^ementary  trend  in  war  games,  motivated  by  those  quantitative  needs, 
toward  narrower,  more  granular  tools  which  are  more  focused  on  issues  relating  to  various 
milestones  in  die  ^sterns  acquisition  {Hocess.  The  roles  and  c^abilities  of  this  emerging  class 
of  wargaming  tools  challenges  the  tradiricmal  perceptions  of  war  games  as  non-quantitative  and 
insight-limited. 

m.  POTENTIAL  APPUCATTONS  OF  WARGAMING  TO  SYSTEMS  ACQUISITION 
A.  .^jpropriate  Problem  Types. 

Many  q)plications  of  wargaming  appropriate  to  helping  decision  makers  during  the  acquisition 
process  were  suggested.  These  are  meant  to  be  primary  triplications  only  and  are  not  meant 
as  an  all-inclusive  list: 

1.  Identify  Critical  Parametets.  Watgaming’s  utility  may  be  greatest  in  identifying 
critical  parametets  for  a  decision  with  other  tools  used  to  refine  the  final  analysis.  Identifying 
critical  parameters  involves  determining  deficiencies  at  the  initiation  of  the  acquisition  process, 
helping  to  focus  on  key  elements  at  the  trade-off  stage,  or  scoping  the  Test  and  Evaluation 
Master  Plan  (TEMP)  for  Phase  I  of  the  acquisition. 

A  primary  use  would  be  to  identify  fundamental  deficiencies  of  a  mission  area,  whether  in 
equqmient,  training,  logistics  support  or  other  parameters.  An  example  might  be  as  a  "sift" 
mechanism  to  help  prioritize  C^C  needs. 

2.  Assist  in  Developing  a  Consensus.  Wargaming  certainly  has  a  place  in 
developing  consensus  for  weqron  systems,  operational  concepts,  or  other  contributors  to 
mission  effectiveness.  This  technique  can  assure  that  important  factors  are  considered,  that 
operators  apply  their  experience  in  a  disciplined  maimer,  and  even  that  key  people  in  the 
decision  process  "take  ownership"  by  participation. 

A  relevant  example  is  the  Navy’s  Maritime  Strategy  developed  in  die  1970s  largely  through 
the  use  of  war  games  at  the  Naval  War  College.  This  strategy  was  key  to  relatively  stable 
and  successful  weapons  acquisition  over  the  past  two  decades.  A  relevant  reference  is  Carl 
Builder’s  book.  The  Masks  of  War:  American  Military  Styles  in  Strategy  and  Analysis,  a 
portion  of  which  was  summarized  by  him  in  a  speech  to  the  Army  Gyrations  Research 
Symposium  and  printed  in  the  June  1987  Phalanx. 
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3.  Ejqdim  brteractions.  War  games  have  greater  utility  in  evening  interactioiis 
between  mission  area  elements  such  as  weapon  system  capatnlities,  persoiuiel  activities,  supptnt 
and  tactics,  dian  do  dosed-foim  analyses.  of  the  {xinc^  uses  of  war  games  is  to 
identify  mianatches  between  missitm  elonoits  which  significantly  inqtact  upon  mission 
effectiveness.  Alternate  solutions  can  be  exercised  in  war  game  formats  or  other  analysis 
techniqpies.  Some  types  of  war  games  may  evm  assist  in  integrating  support,  tactics,  and 
training  into  die  weapon  system. 

4.  Compare  Alternatives.  Wargaming  has  primary  qiplicatitm  in  con^iarison  of 
alternatives.  This  application  goes  beycxid  weipon  system  acquisiticHi  to  include: 

a.  Alternative  scoiaiios.  Missitms  can  be  assessed  in  a  plectrum  of 
reastmable  scenarios,  and  sensitivities  to  scenario  variations  can  be  analyzed. 

b.  Tactics/doctrine  options.  Oftentimes,  tactics  changes  may  gready 
ameliorate  mission  deficiencies.  Possibly  doctrine  changes  may  be  required  to  solve  a  missiem 
problem.  These  inqiacts  can  be  assessed  dirough  war  games. 

c.  System  trade-offs.  War  games  have  long  been  used  in  system  trade¬ 
off.  Uses  include  not  only  wetpon  system  capabilities  trade-offs,  but  also  trade-offs  among 
other  system  elements  such  as  support  equipment,  personnel,  training,  and  logistics. 

d.  Acquisitiem  process.  Wargaming  might  be  iqplied  to  the  acquisition 
process  of  a  particular  wetqxm  system  to  assess  different  acquisition  strategies  (such  as 
requiring  prototype  or  not),  tdtemative  schedules,  and  budget  stream  options. 

e.  Path  games.  Path  games  might  be  used  to  compare  alternative  system 
concepts  throughout  their  operational  lifetimes,  with  changing  scenarios,  as  contrasted  to  a  state 
game  set  at  ICXT. 

f.  Competitive  strategies.  War  games  are  probably  ideal  (by  their  basic 
design)  for  defining  weapon  system  and  operational  concepts  which  c^italize  on  enemy 
weaknesses. 


g.  Damage  control.  War  games  have  good  capability  to  assess  impacts  of 
players  external  to  DOD. 

5.  New  Frames  of  Reference.  Wargaming  is  an  ^ropriate  tool,  and  possibly 
the  only  one,  for  assessing  impacts  on  our  war  fighting  ciq>ability  of  major  changes  to  our 
world  environment  such  as  we  are  experiencing  today. 

a.  Perestroika.  In  response  to  this  Gorbachev  initiative,  there  may  be 
potoitially  large  reductions  in  warfighting  c^ability.  Wargaming  may  be  a  practical  way  to 
demonstrate  the  impacts  of  these  reductions. 

b.  Budget  reductions.  DOD  budget  reductions  are  certain,  only  the 
magnitude  is  unknown.  Wargaming  could  be  a  suitable  tool  for  assessing  the  U.S.’  ability 
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to  meet  its  national  objectives  within  various  budget  reduction  scenark>s.  Not  only  should 
force  structure,  weq;K)n  system  procurement,  and  strategicAactical  strategy  be  assessed,  but 
also  requirements  for  wartime  surge  by  the  industrial  base  and  personnd  recruiting  and  training 
system  could  be  examined. 

c.  Acquisition  i»ocess  reforms.  Anodier  new  frame  of  reference  is  also 
being  imposed  tm  the  acquisititm  process  by  DOD  acquisition  refoims  such  as  the  Defense 
Management  Report  (DMR).  Acquisition  refoim  may  have  major  impact  on  the  acquisiticm 
process,  and  diese  changes  could  be  evaluated  throu^  suitable  games. 

6.  Provide  a  ccmimon  language.  A  major  advantage  of  war  games  is  to  provide 
an  opportunity  for  system  q)erators,  logisticians,  tacticians,  technology  experts  and  other 
"staki^lders"  in  the  system  acquisition  process  to  work  together  in  a  muctur^  envirtnunent. 
Wargaming  mixes  people  with  quantitative  and  non-quantitative  backgrounds,  thus,  allowing 
players  other  than  aiudysts  to  participate.  By  their  nature  war  games  pose  questions  requiring 
meimingful  resptmse  in  each  player’s  own  language.  However,  the  war  game  results  in  a 
common  language  representation  (briefing  or  report). 

This  commtm  language  allows  the  various  conq)onents  of  the  acquisition/operation  community 
to  participate  meaningfully  in  the  synthesis  of  mission  capabilities,  acquisition  of  new  weapon 
systems,  and  change  to  operaticmal,  tactical  or  support  concepts. 

B.  Inqrpropriate  Problem  Types. 

Some  uses  of  war  games  are  obviously  inappropriate  for  system  acquisition.  Cost  and  budget 
decisions  are  usually  imppropnate  applications,  and  it  may  be  iruq^ropiiate  to  use  wargaming 
directly  in  weiqxm  system  down-select.  However,  in  fact,  man-in-the-loop  simulations  will  be 
used  to  assist  in  the  LHX  down-select,  so  a  form  of  wargaming  even  has  this  use. 

Other  iniqrpropriate  uses  were  discussed,  but,  in  most  cases,  these  were  judged  to  be 
in^jpropriate  only  due  to  state-of-the-art,  software  and  experience  deficiencies,  not 
fundarr^tally  in  using  wargaming  for  specific  implications. 

IV.  CAPABILITIES  AND  LIMITATIONS 

A.  General  Cqridrilities  and  Limitations. 

The  curabilities  and  limitations  in  this  section  resulted  from  discussions  of  wargaming  in  the 
acquisition  process.  Although  the  panel  members  agreed  that  these  are  important  and  should 
be  included  here,  none  are  exclusively  applicable  to  acquisition.  They  are  presented,  however, 
for  conpleteness. 

1.  Objectives.  Clear  statements  of  aipropriate  game  objectives  may  be  the  most 
inportam  aspect  of  a  war  game.  Upon  objectives  hinge  decisions  about  game  design,  data 
requirements,  player  selection,  number  of  replications,  facilities,  and  amoimt  and  type  of 
ctmputer  stpport.  Several  attempts  at  specifying  the  objectives  will  probably  be  needed  before 
they  are  satisfactorily  obtained.  They  must  not  be  so  global  that  nearly  any  game  could  be 
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used,  nor  so  qiecific  dut  the  results  are  specified  in  advance.  Widi  s<xne  uses  of  war  games 
it  is  possiUe  that  there  is  some  known  desired  mitcome  (e.g.,  cmisensus  building).  Howeva-, 
dutt  objective  must  be  clearly  defined  as  a  game  objective. 

2.  Players.  The  "right"  pec^le  are  required  as  players,  but  choosing  diose  right 
players  is  difficult.  Using  our  earlier  definition  of  conceptual  versus  focused  games,  the 
focused  game,  such  as  a  man-in-the-loop  system  simulati<Hi,  tokls  to  use  sy^em  q)erators. 
The  broader  oxiceptual  game  usually  needs  experts  from  several  specific  fields,  and  getting 
the  rigjit  mix  of  these  otperts  is  difficult.  Even  experienced  gamers  admit  that  they  do  not 
always  choose  the  tight  mix  of  players.  Widwut  that  mix,  the  objectives  of  die  game  ate 
difficult,  if  not  impossible  to  satisfy.  However,  since  one  of  the  needs  satisfied  by  watgaming 
is  gleaning  expert  knowledge,  and  since  one  of  the  payoffs  of  concqitual  watgaming  is  the 
insights  gained  by  interaction  of  players  with  varied  backgrounds,  it  is  important  that  the 
choice  of  players  be  defined  rather  than  left  to  chance. 

3.  Timelines.  The  time  periods  diat  can  be  covered  in  a  conceptual  war  game 
ate  both  an  advantage  of  wargaming  and  sometimes  a  hindrance  to  its  conduct.  Months  of 
war  can  be  covered  in  only  a  few  days  of  play.  There  has  even  been  discussion  of  designing 
the  Navy  GLOBAL  war  game  to  represent  an  extended  war  (e.g.,three  years). 

However,  the  players  may  have  difficulty  relating  to  time  spans  that  might  be  covered  by  evm 
one  of  their  moves.  For  example,  if  the  time  period  is  10  days  and  soinething  drastic  h^ipens 
within  the  10  days,  the  players  may  object  that  they  would  never  have  allowed  that  situation 
to  develop;  that  by  day  S,  say,  they  would  have  developed  an  alternate  strategy.  Also,  game 
termination  may  occur  in  mid-period  (e.g.,  a  critical  command  unit  is  annihilated). 

4.  Data  Bases.  In  general,  data  bases  are  problems  for  the  war  gamer.  Defining 
die  data  required  for  a  specific  game,  the  ippropriate  detail  or  level  of  aggregation,  and  the 
data  sources  are  nearly  idways  difficult.  CoUecting  the  data  is  always  resource  intensive,  and 
then  storing  it  in  an  easily  accessible  form  is  difficult.  Collecting  required  data  during  the 
game  and  later  reducing  them  to  satisfy  game  objectives  are  also  problems.  Additional 
problems  accrue  when  qiecial  access  or  proprietary  data  is  involved.  Careful  design  and  future 
hardware/software  developments  may  someday  aUeviate  these  problems. 

5.  Facilities.  Facilities  must,  of  course,  be  available.  However,  facility 
requirements  vary  nearly  as  much  as  the  types  of  war  games.  For  man-in-the-loop  simulations, 
extreme  fidelity  to  a  specific  system  may  not  be  necessary,  depending  upon  the  purpose  of  the 
game,  but  displays  must  be  somewhat  realistic  (e.g.,  a  pilot  would  not  fly  a  simulator  based 
on  typed  pages  of  information).  For  conceptual  games,  the  requirements  include  adequate 
numbers  of  rooms  with  tables,  chairs,  map  boards,  chalk  boards,  flip  charts,  word  and  graphic 
processing  crpabilities.  The  amount  of  computer  suppon  and  numbers  of  terminals  required 
depend  upon  game  design.  However,  for  b^  use  terminals/computers  should  be  located  in 
player  rooms  ratlwr  than  at  some  other  location.  There  must  be  separate  but  accessible  rooms 
for  the  control  team  and  each  of  the  player  teams  and  one  suitable  for  plenary  sessions  of  the 
entire  group.  If  players  are  to  concentrate  on  the  game  rather  than  the  surroundings,  the 
physical  environment  must  be  suitable.  (Adequate  heat  and  air  conditioning  are  a  must.) 
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6.  Hardware/softwaie.  The  amount  of  either  of  these  that  is  used  in  acquisition 
war  games  ranges  from  lume  to  extensive.  Chie  panel  member  suggested  that  computer 
assisted  danuige  assessment  and  precise  computer  data  are  seldom  needed  for  a  particular  type 
of  ctHKeptoal  war  game.  However,  players  expected  that  conqHiters  would  be  used  to  such 
an  extraiA  that  th^  were  told  that  data  came  from  a  computer  or  were  provided  ccmqHiter 
I»intouts  just  to  inake  them  more  comfortable. 

7.  Qualitative  versus  quantitative.  In  the  usual,  more  traditional  war  games, 
results  are  usually  considered  qualitative.  Further,  it  is  frequently  argued  that  human 
interactions  cause  random  events,  making  quantitative  analysis  itiqxrssible.  However,  this 
working  group  decided  diat  quantitative  results  could  be  olMained  if  resources  are  available 
to  design,  control,  and  run  multiple  replications.  Depending  upon  the  game  objective  and 
decisions  to  be  made,  one  can  use  enough  replications  to  develop  confidence  in  the  results  or 
to  actually  satisfy  a  statistical  design,  such  as  Latin  Squares. 

Man-in-the-loop  system  simulation  ate  usually  specifrcally  designed  to  allow  easy,  automated 
collection  of  a  wide  variety  of  data.  Aldiough  there  was  much  discussion  about  whether  these 
were  actually  war  games,  there  was  agreement  that  diey  can,  have  been,  and  should  be  used 
to  collect  quantitative  data  (at  least  for  those  types  of  data  that  can  be  collected  by  and  have 
been  programmed  into  the  data  collection  device). 

8.  Post-Game  Analysis.  Tools  are  inadequate  or  lacking  for  appropriate  analysis. 
B.  Institutional  Considerations. 

A  major  concern  is  handling  of  Special  Access  Required  (SAR)  program  data.  Although  we 
don’t  have  a  solution  to  this  problem,  highly-aggregate  war  games  may  not  require  sharing 
of  data  with  all  players.  For  instance,  one  cleared  player  may  represent  a  SAR  system. 

There  continue  to  be  problems  with  cross-service  data.  Rather  than  risk  compromise  or  misuse 
of  their  data,  endangering  their  programs.  Services  are  generally  reluctant  to  share.  A 
corollary  to  this  problem  is  contractor-restricted  or  sensitive  data.  Contractors  are  especially 
concerned  about  losing  control  of  propiietaiy  data.  In  some  cases,  offices  within  Services 
are  reluctant  to  share  data.  These  Service-unique  problems  must  be  solved  by  the  particular 
service,  and  a  recommendation  from  this  woricshop  is  probably  not  warranted. 

V.  EVOLUTION  OF  WARGAMING  APPUCATTONS  TO  SYSTEMS  ACQUISITION 

A.  Past  Techniques  Applied. 

1.  Seminar:  Time  Step  -  Non-Continuous  Qock. 

a.  Micro  assisted. 

b.  Look-up  table  assisted. 

Seminar  games  at  the  Naval  War  College  focus  on  Strategic  and  Operational  levels  in  theater 
and  regional  areas.  Odier  uses  include  identification  of  shortfalls  in  funding  priorities,  mission 
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•tea  analysis,  damage  control,  policy  evaluatitm,  consensus  building,  team  building,  future 
scenario  development  and  strategic  concept  formulation.  These  techniques  deal  widi  large 
issues  diat  involve  long  timelines. 


2.  Computer  Driven:  Interactive  -  Continuous  Qock. 

a.  ENWGS. 

(1)  mm-distributed. 

(2)  distrilMited. 

b.  JTLS. 

c.  RSAS. 

Examples  of  Computer  Driven  games  include  those  where  interactive  players'  interface  is  vital 
for  obtaining  desired  objectives.  Large  gaming  "systems"  like  ENWGS,  JTLS  and  RSAS 
require  this  interface.  Keeping  current  and  mutually  exclusive  data  requires  extensive 
manpower.  These  systems  lend  implication  to  more  tactical,  short  timeline  scenarios  and  more 
granular  outcomes. 

3.  Manual:  Continuous  Qock. 

a.  Micromodel  Assisted. 

b.  CIBA^w  Intensity  Conflict  (LIC)/Structured  or  Unstructured/Dynamic. 

This  type  of  game  is  continuous  clock  and  usually  relies  on  expen  wimess  or  operational  an, 
but  may  be  supponed  by  computers.  It  lends  itself  to  a  non>scripted,  dynamic  process  that 
may,  but  rteed  not,  include  current  data  bases.  This  style  of  game  permits  introduction  of  new 
systems  not  otherwise  easily  simulated. 

4.  Exercises. 

a.  WINTEX. 

b.  BLUE  FLAG. 

Exercises  may  not  be  games  in  the  classic  sense  because  they  are  scripted  in  such  detail. 
However,  insights  ate  often  gained  from  exercises,  and  exercises  may  serve  similar  purposes 
as  mote  traditional  games.  For  example,  insights  gained  from  exercises  may  cause  planners 
and  decision  makers  to  reexamine  assumptions  embedded  in  their  war  plans.  Both  exercises 
and  war  games  assist  in  team  building,  training  and  consensus  building. 

5.  Simulations. 

a.  Man-in-thC'Loop. 

(1)  SIMNET. 

(2)  MACS. 

b.  Man-not-in-the-Loop. 

(1)  Qosed  Form  -  Digital. 

(2)  Industrial  Analysis  tools. 
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B.  Cunent  Techniques  That  Could  Be  Applied.  The  techniques  described  above  ("Past 
Techniques")  are  qpfdkaUe  in  the  cunent  time  frame. 

C.  Future  Tedmiques. 

Combinations  of  current  techniques  will  be  inq}oitant.  Given  that  all  of  the  techniques  listed 
above  (paragnq^  A)  can  be  applied  to  future  problems,  inqnovements  in  the  cq>ability  to 
accomplish  the  game  process  (pre-game  preparation,  conduct,  and  post  game  analysis)  will 
occur.  Problems  listed  in  Part  II.B  need  to  be  addressed. 

1.  Along  the  lines  of  the  JCS/DARPA  program,  Intemetted  Warfighting  Aiudysis 
equability  (IWAC),  current  techniques  may  be  distributed  among  major  players.  Video 
ConfereiK^  and  computer  techniques  may  be  combined  to  support  a  variety  of  objectives. 

2.  Features  of  current  techniques  can  be  combined  to  improve  the  quality  of  the 
output,  and  enable  additional  problems  to  be  addressed. 

a.  Combine  manual  and  computer  driven  techniques  to  examine  new  system 
parameters  and  to  compare  current  capabilities  and  tactics  with  fbture  concepts. 

b.  Combine  seminar  and  manual  or  computer  driven  techniques  to  address 
longer  periods  of  time,  while  still  able  to  examine  selected  points  on  the  timeline. 

c.  Combine  seminar  and  manual  or  computer  driven  techniques  with 
simulations.  Use  the  seminar  technique  to  set  initial  conditions  for  a  simulation  of  a  speciric 
system,  and  then  incorporate  the  results  of  the  simulation  into  the  stream  to  add  a  desirable 
degree  of  "reality." 

3.  Improve  Support  Capability.  The  pre-game  and  post  game  analysis  phases 
tend  to  be  maiqrower  intensive.  The  major  problems  identiried  previously  need  to  be 
addressed.  These  ait: 

a.  Assessment  tools  and  models. 

b.  Data  collection  (and  reduction)  techniques. 

c.  Data  base  man^ulations. 

VI.  INSIGHTS/PERCEPTIONS,  CONCLUSIONS  AND  RECOMMENDATIONS 
A.  Insights/Perceptions. 

1.  The  broad  definition  of  "wargaming"  used  in  this  woikshop,  and,  therefore, 
the  inclusion  of  techniques  such  as  man-in-the-loop  simulation  have  permitted  wargaming  new 
qiplicatum  in  the  acquisition  process.  This  broader  perspective  of  wargaming  caused  us  to 
consider  how  we  might  employ  new  gaming  technologies.  Not  having  perceived  these  forms 
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as  war  games  in  the  past  may  have  limited  their  en^loyment.  Admitting  the  possibility  diat 
a  iHoader  perspective  may  exist  is  the  first  step  in  exploring  broadened  qjplicaticms. 

2.  In  the  defense  acquisition  process,  war  games  tend  to  fall  into  two  broad 
classes,  ctmceptual  acquisitiiMi  war  games  and  system-focused  acquisition  war  games.  The 
former  are  used  more  in  the  front  end  of  the  acquisition  process,  while  system-focused 
acquisition  war  games  occur  after  trade-ofrs.  The  former  tend  to  be  more  global,  general,  and 
broad  in  nature,  while  the  latter  are  local  and  specific.  Cimcqitual  games  tmd  to  be 
low-overhead,  require  subject  area  experts,  entail  single  time  stepped  games,  and  have  ouqiuts 
focused  on  insight.  The  system  focus^l  acquisition  war  games  tend  to  involve  extensive  effort 
during  pre-game,  have  a  heavy  experimentiEd  design  flavor,  entail  multqile  iteriuions,  require 
technical  experts,  and  generate  comparison  oriented  outputs. 

3.  War  games  provide  a  stmcture  for  e:q>loring  non-incremental  issues.  When 
radical  changes  from  die  norm  occur,  such  that  traditional  tools  and  yardsticks  no  longer  rqiply, 
one  should  consider  wargaming  to  create  new  "frames  of  reference".  For  instance,  if  die 
present  acquisition  process  is  perceived  to  be  inadequate,  war  games  might  explore 
fundamentally  new  processes. 

4.  With  certain  types  of  war  games,  such  as  the  class  of  system  focused 
acquisition  war  games  mentioned  above,  conqiarisons  are  possible.  Admittedly  these  are 
relative  vice  specific,  but  they  are  permitted  by  a  broadened  definition  of  wargaming. 

3.  Aspects  of  wargaming  that  are  not  done  well  include; 

a.  Setting  the  proper  objectives. 

b.  Designing  games  to  olHain  desired  data. 

c.  Constructing  data  bases  required  for  a  war  game. 

d.  Distilling  the  results  into  a  meaningful  set  of  value  to  the  decision-maker. 

6.  Whereas  previously  we  may  have  had  to  wait  for  prototypes  to  be  built,  with 
war  games  we  are  able  to  detect  interface  problems  eailier  in  development.  The  earlier  that 
problems  are  detected,  the  greater  the  potential  impact  and  cost  savings.  Further,  conceptual 
system  acquisition  war  games  help  to  illuminate  choices  at  a  time  when  they  still  may  be 
exercised. 

7.  Acquisition  war  games  provide  a  common  language  between  communities. 

8.  As  greater  numbers  become  involved  in  war  gaming,  we  will  see  a  rise  in 
triplications  new  to  the  tqiic  area. 

9.  There  is  a  disadvantage  of  special  access  war  games  in  that  they  restrict  the 
numbers  of  games  and  players,  so  these  trends  ate  inhibited. 
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B.  Cooclusioa. 


The  use  of  watgaming  in  die  ^stem  acquisition  process  is  appnqiriate  for  examining  a  wide 
variety  of  objectives  across  a  breadth  of  topic  areas  frtnn  initial  needs  analysis  to  final 
milestones.  War  games  have  potential  to  shorten  the  acquisitUMi  process,  at  a  reduced  cost, 
and  lead  to  earlier,  smarter  decisions. 

C.  Recommendations. 

The  Workshop  group  devoted  to  systems  acquisition  developed  four  reccmunendatitnis,  shown 
below.  These  are  not  identical  with  the  recommendations  of  the  Workshr^  as  a  whole. 

1.  That  additional  study  of  seminar  war  games  be  conducted.  The  earlier  the 
correction  of  problems  in  die  acquisition  process  the  greater  the  intact.  The  seminar  war 
game  is  often  the  format  utilized  in  the  war  games  conducted  during  the  early  portions  of  the 
acquisition  process.  Additional  focus  on  that  format  of  game  may  prove  very  beneficial. 

2.  That  research  be  conducted  on  how  to  bener  design,  execute,  and  ccmduct  the 
post-game  phase  of  war  games. 

3.  That  a  hierarchical  series  of  conceptual  war  games  be  conducted  to  establish 
Service  strategies.  The  acquisition  process  can  then  reference  these  strategies  to  establish  how 
a  particular  procurement  supports  them.  A  factor  in  the  relative  success  the  Navy  has  enjoyed 
in  acquisititm  has  been  its  ability  to  demonstrate  how  acquisitions  related  to  strategy.  The 
Maritime  Strategy  evolved  from  war  games  conducted  at  the  NWC.  A  hierarchical  set  of  such 
games  would  start  with  national  strategy,  consider  the  defense  strategy,  and  finally  the  Service 
strategies. 

4.  That  DOD  5000  series  be  revised  to  incorporate  the  role  of  wargaming  in 
acquisition  of  major  systems. 
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APPENDIX  D 

TEST  &  EVALUATION  GROUP  REPORT 


I.  INTRODUCTION  OF  WARGAMING  IN  TEST  &  EVALUATION 
A.  Definitions  and  Background. 

1.  Definition  of  Test  &  Evaluaticm.  The  Test  &  Evaluation  (T&E)  process  was 
viewed  as  qjplicable  throughout  the  life  of  a  weqwn  system.  For  purposes  of  this  workshop, 
however,  die  discussion  focused  almost  exclusively  upon  that  part  of  die  develqxnmtal 
system’s  cycle  addressed  in  the  Test  and  Evaluation  Master  Plan  (TEMP).  Furthermore, 
particular  enqdiasis  was  placed  t^n  the  Operational  Test  and  Evaluation  (OT&E)  period  of 
die  TEMP.  It  must  be  errqihasized  that  the  constriction  of  the  tt^ic  area  was  made  to 
accommodate  the  time  period  available  for  the  workshop  and  is  not  indicative  of  any 
recommended  constriction  of  the  basic  definition  and  scope  of  T&E. 

2.  Definition  of  War  Game.  Again,  (fefinitions  were  constricted  to  conform  to  the 
time  constraints  of  the  workshop,  and  to  foster  clear  and  concise  discussion.  While  it  was 
recognized  that  the  intent  of  the  worktop  was  to  address  the  qiplication  of  models, 
simulations,  and  war  games  to  the  Test  &  Evaluation  environment,  it  became  clear  that  a  more 
focused  qiproach  was  dictated  by  the  schedule.  This  led  to  the  de  facto  understanding  that 
models  arid  simulations  provide  a  clear  resource  for  the  Test  &  Evaluation  community.  What 
was  not  so  clear  was  die  potential  role  for  wargaming  within  the  Test  &  Evaluation 
environment.  Therefore,  the  effort  was  stricdy  focused  upon  wargaming. 

3.  Purpose  of  War  Games  in  T&E.  The  following  thoughts  on  the  purpose  of  a 
war  game  by  Dr.  Peter  Perla  were  taken  as  a  point  of  departure: 

War  games  revolve  around  human  decisions.  Learning  from  war  games  comes  from 
both  the  experience  of  making  decisions  and  from  the  process  of  understanding  why 
those  decisions  are  made.  The  outcomes  of  decisions  are  defined  by  mathematical 
models  that  are  often  similar  to  those  of  analysis,  however,  these  models  are  employed 
in  a  fundamentally  different  way.  Wargaming  models  are  typically  stochastic  in  nature 
"  the  “roll  of  the  dice"  provides  a  wide  range  of  possible  outcomes  or  snapshots  of 
reality  with  which  the  players  must  deal.  In  this  sense,  model  results  should  ^ 
considered  inputs  to  war  games,  whereas  such  results  are  often  the  outputs  of  analyses. 
War  games  do  not,  and  should  seldom  attempt  to,  produce  quantitative  measures.  Their 
value  lies  in  qualitative  assessments  of  why  decisions  are  made.  Thus,  to  exploit 
wargaming,  the  physical  sciences  must  give  way  to  a  new  paradigm,  that  of  history. 
People  and  decisions  become  paramount.  (Peter  P.  Perla  and  Raymond  T.  Barrett, 
"What  Wargaming  Is  and  Is  Not,"  Naval  War  College  Review,  Sep-Oct  1985.) 

The  definition  of  a  war  game  was  also  taken  from  Dr.  Perla’s  work  and  helped  maintain  a 
clear  focus  upon  the  distinctions  between  war  games  and  simulations: 
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A  war  game  is  a  warfare  model  or  simulation  whose  sequence  of  events  is  interactively 
affected  by  declaims  made  by  players  representing  of^rosing  sides,  and  whose  operation 
does  not  involve  the  activities  of  actual  military  farces.  The  key  wards  in  this  definition 
are  players  and  decisions.  Fundamentally,  wargaming  is  an  experimeru  in  human 
interaction  and  is  best  used  to  investigate  processes,  not  to  calculate  outcomes.  (Peter 
P.  Perla,  "War  Games,  Analyses,  and  Exercises,"  Naval  War  College  Review,  Spring 
1987) 

B.  Reasons  for  Using  Waigaming  in  Test  &,  Evaluation. 

1.  As  weqwn  systems  become  more  con^lex  and  e3q)aisive  to  test,  alternatives 
to  laboratory  and  field  testing  must  be  considered.  Qmstraints  <m  testing,  such  as  cost, 
security,  safety,  availability/adequacy  of  test  instrumoitation/ranges,  treaty  and  envircmmaital 
constraints,  availaUe  test  time,  number  and  maturity  of  test  articles,  and  representative  terrain 
and  weather  may  combine  to  preclude  a  conqrlete  evaluaticm  of  a  system  throu^  field  testing 
alone.  In  fact  OTAE,  at  best,  is  itself  a  simulation  of  actual  cmnbat  conditions. 

2.  Wargaming  can  also  be  an  excellent  tool  for  developing  tactics,  enqrloyment 
{wocedures,  and  operations  concepts  for  a  new  system.  Too  often  we  learn  how  to  effectively 
etiqrloy  or  incorporate  a  new  durability  into  die  force  mly  after  procurement  and  fielding. 
Therefore,  the  system's  use  is  subopdrnized  during  the  testing  process,  which  handicrqrs  the 
evaluation  of  die  system.  Using  wargaming  to  develop  or  examine  employment  concepts 
before  the  system  is  fielded,  not  only  makes  fielding  a  smoother  operation,  but  may  also 
facilitate  more  accurate  judgments  of  its  opabilities.  Furthdmore,  any  information  or  insights 
gleaned  from  wargaming  early  in  the  acquisiticm  cycle,  could  be  incorporated  into  early 
operatiorud  assessments  (EGAs)  of  expected  system  durabilities. 

n.  PAST  APPUCATIONS  OF  WARGAMING  TO  T&E 

A.  Specific  Exanqrles. 

Many  examples  were  presented  of  past  qrplications  of  wargaming  to  T&E.  One  example  is 
on-going  work  for  an  advanced  Air  Defense  Artillery  (ADA)  system.  Wargaming  was  used 
to  develop  tactics  and  procedures  which  were  subsequently  used  in  field  testing.  Wargaming, 
which  included  the  operators,  testers,  and  analysts,  identified  nuiny  factors  in  employment  and 
data  requirements  which  otherwise  may  have  only  been  found  after  the  test  was  run. 

B.  Problems  and  Limitations. 

The  integration  of  higher  classification  information  into  a  war  game  is  a  continuing  problem. 
For  die  foreseeable  future,  die  full  potentialities  of  war  games  will  be  limited  by  the 
precautions  taken  to  safeguard  higher  classification  information  on  both  friendly  and  hostile 
systems  and  dieir  operational  practices. 

1.  On  die  positive  side,  a  great  deal  of  higher  classified  information  is  constandy 
being  sanitized  and  made  available  to  the  analytic  community  and  to  game  developers  and 
players.  Additirmal  sanitized  data  can  be  provided  by  special-access  cells  organized  to  support 
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games.  On  the  negative  side,  however,  is  die  reality  that  these  remedies  are  partial  in  nature, 
mi^  or  mi^  not  sufficiently  infonn  die  gaming  process  to  achieve  gaming  objectives,  and  are 
more  heipfiil  for  war  games  in  goieral  dian  for  war  games  cmceiiied  with  T&E. 

2.  There  are  two  basic  situatimis  that  must  be  addressed:  systems  which  are 
inherently  Black  or  Special  Access  Programs  (SAP)  in  nature;  and  diose  whidi  are  in  the 
White  world  Dtiioae  performance  is  impacted  by  Black  systems. 

(a)  SAP  systems  are  required  to  undergo  a  T&E  ]»ocess  similar  to 
conventional  programs.  Integraticm  of  this  ^cifically  guarded  information  into  die  various 
jdiases  of  T&E  must  maintain  the  covertness  of  the  program  while  allowing  for  adequate 
scrutii^  of  the  requirements,  need,  and  mission. 

(1)  The  use  of  wargaming  in  the  T&E  process  for  SAP  systems  should 
focus  (Ki  the  Test  Concept  and  Test  Design  jdiases,  while  the  Test  Plan,  Test  Conduct,  and 
Evaluation  {diases  are  better  left  to  simulation  and  analysis  for  additional  insight.  The  human 
can  interact  in  the  Concqit  and  Design  {diases  through  a  war  game  of  ^ropriately  cleared 
players  to  access  mission  applicability  and  testability  and  the  robustness  of  the  requirement  to 
meet  the  perceived  threat.  The  perceived  threat  should  be  provided  at  the  highest  classification 
level  possible  so  that  we  truly  assess  our  best  capabilities  against  die  most  credible  threat. 

(2)  The  mission  and  operational  requirement  assessment  for  SAP 
systems  can  be  supported  by  wargaming  by  briefing  selected  players  representing  multiple 
dscqilines  and  having  them  interact  in  a  seminar  type  war  game  to  bound  the  problem.  Such 
a  game  would  allow  technical  experts  who  have  bren  associated  with  the  program  to  interact 
with  operational  commanders  when  assessing  the  appl 'cation  of  the  system  under  review. 

(b)  When  examining  the  role  of  wargaming  in  the  assessmem  of  White 
systems  which  must  interact  with  SAP  systems,  the  classification  level  of  the  war  game 
becomes  a  key  issue.  There  are  two  basic  situations  that  must  be  examined:  that  where  the 
primary  reason  for  the  classification  is  source  protection;  and  that  where  the  information  itself 
is  highly  classified. 


(1)  In  the  first  situation,  where  we  are  dealing  primarily  with  the 
protection  of  sources,  off-line  cells  can  play  at  the  required  classification  level  and  pass 
downgraded  information  to  the  main  game  participants.  Since  player  decisions  should  reflect 
the  information  that  they  are  provided  and  not  its  source,  this  process  should  not  impact  upon 
the  validity  of  game  (fesign. 

(2)  The  second  situation,  where  the  data  itself  could  significantly 
change  when  downgraded,  is  entirely  different.  A  major  concern  when  conducting  wargaming 
at  several  classification  levels  (blackAvrhite)  is  the  situation  where  black  data  differs 
substantially  from  its  white  counterpart.  If  the  game  is  being  conducted  in  the  White  woild 
witii  qtecific  Black  world  items  being  fed  to  the  white  game,  the  game  will  necessarily  utilize 
incorrect  data.  This  could  lead  to  very  different  outcomes  than  those  which  would  have  been 
obtained  with  Black  data.  This  would  negate  the  war  game’s  utility.  More  importantly,  it 
could  lead  to  incorrect  doctrinal,  organizational,  and  acquisition  decisions. 
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(3)  The  possibility  of  fundamentally  different  data  inqMCting  the 
game  requires  awareness  on  the  pait  of  the  war  game  q>onsor  and  war  game  desi^ms.  They 
mutf  deieimine  whedm  the  Black/White  data  discrqMiKies  are  accqxable.  Detomining 
acceptability  must  include  examination  of  die  discrepancy’s  effect  on  ^  decisi<»is  die  data 
would  influence. 

ffl.  POTENTIAL  WARGAMING  USES  IN  TEST  &  EVALUATION 
A.  .^jpropriate  Applications. 

Models,  simulations,  and  wargaming  can  be  invdked  as  planning  or  evaluation  tools  to 
augment  or  extend  realistic  field  testing.  Wargaming  applications  in  T&E  may  be  most  useful 
when  planned  and  conducted  early  in  the  system  acquisitiem  cycle,  beginning  as  early  as 
Milestone  0. 

1.  Potoitial  qiplications  include  situations:  where  fog-of-war,  projected  threats, 
jamming,  deceptkm,  and  other  counter-measures  cannot  be  replicated  in  a  field  test;  when  the 
system  under  test  is  only  one  part  of  a  larger,  conqilex  weqion  system  consisting  of  many 
conqxments  or  systems  that  must  interact  in  real  time  (e.g.,  FAADS,  strategic  defense 
systems);  when  evolving  Soviet  or  Third  World  tactics  and  doctrine  must  be  evaluated;  and, 
in  general,  to  address  issues  which  cannot  be  fdiysically  tested. 

2.  General  Applications 

(a)  Investigations  of  human  performance  under  stress  conditions.  The 
performance  can  be,  but  is  not  limited  to,  mformation  overload,  decision  time  compression, 
and  mental  and  physical  fatigue. 

(b)  Investigations  of  system  and  organization  interactions.  War  games  would 
be  particularly  useful  here  as  these  interactions  rely  heavily  on  the  human  thought  process  and 
interactions.  Also,  interactions  among  organizational  elements  can  be  varied,  stressed  and 
otherwise  evaluated;  the  net  result  being  the  identification  of  deficiencies  in  organizatioiud 
relations!!^. 


(c)  Preliminary  investigations  of  tactics  or  doctrine.  While  war  games  were 
considered  relevant  in  this  area  with  the  potential  to  make  considerable  contributions,  there  is 
also  the  potential  for  serious  abuse  of  the  tools.  Specifically,  the  model  used  to  support  a 
war  game  addressing  tactics  or  doctrine  must  be  sufficiently  robust  in  the  essential 
representation  of  wetqxrn  system  performance  and  interaction.  Models  which  rqjresent  EW 
effects  but  do  not  cjq>ture  the  physics  of  electromagnetic  propagation  should  not  be  used  to 
refine  tactical  formations  or  penetration  routes  and  tactics. 

3.  Specific  ^>plications 

(a)  Wargaming  can  assist  in  the  identification  of  critical  technical  and 
operational  issues  to  be  addressed  during  testing,  and  can  help  in  defining  both  qualitative  and 
quantitative  "measures  of  merit"  to  be  included  in  the  test  design.  Wargaming  is  particularly 
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wen  miteri  this  investigative  role  because  situations  can  arise  in  a  war  game  that  would 
have  been  m^possihle  to  anticquite  in  the  normal  planning  process  for  OT&E. 

(b)  Based  (m  the  intended  environment  (force  structure,  direat,  tactics, 
strategy,  and  doctrine),  wargaming  can  identify  broad  bounds  for  the  test  planning  proUem  and 
identify  modifications  to  the  test  design. 

(c)  Wargaming,  especially  with  hardware-in-the-lo<^  (including  threat 
simulators),  might  be  used  to  conduct  non-destructive  evaluati<His  of  high  cost  itons  which 
would,  by  dieir  nature,  be  destroyed  in  actual  hardware  tests. 

(d)  Watgaming  can  provide  multiple  enviioiunmts  for  examining  test 
questions  ctmceming  unavailable  threat  systems. 

(e)  Wargaming  can  permit  an  examination  of  system  performance  under 
different  scenarios  and  levels  of  force  aggregation. 

(f)  Wargaming  can  provide  insights  leading  to  the  develt^ment  of  new 
tactics  and  techniques  of  employment  for  new  weiq)on  systems  undergoing  T&E. 

(g)  Wargaming  can  facilitate  an  assessment  of  test  events  that  would 
otherwise  be  exposed  to  threat  intelligence  exploitation. 

(h)  Wargaming  can  provide  insights  into  the  adequacy  and  suitability  of  the 
planned  operational  concepts. 

(i)  Wargaming  can  represent  the  input,  process,  and  output  of  non-avaUable 
systems,  subsystems,  or  components  (friendly  or  tlwat)  or  represent  the  whole  integrated 
system  when  aU  components  are  not  available. 

(j)  Perhaps  outside  the  strictest  definition  of  T&E,  war  games  might  be 
designed  to  examine  wetqwn  system  technical  and/or  operational  requirements,  panicularly  in 
terms  of  force  levels  and  force  architectural  issues. 

B.  IruqTpropriate  Applications. 

Many  pitfalls  were  uncovered  dining  the  course  of  the  worirshop.  These  pitfalls  stem  from 
misunderstandings  on  the  part  of  T&E  sponsors  and  decision  makers  as  to  the  strengths  and 
weaknesses  of  wargaming.  Increased  communication  between  these  individuals  and  the 
wargaming  providers  is  essential.  Experience  has  shown  that  a  pregaming  session  attended 
by  representatives  with  the  capacity  and  authority  to  make  decisions  greatly  benefited  the 
conduct  of  the  actual  war  game.  When  the  same  representatives  ate  at  both  the  game  session 
and  the  planning  session,  most  problems  are  quickly  and  easily  resolved.  Four  specific  pitfalls 
uncovered  during  the  course  of  the  workshop  are  discussed  below.  The  specific  pitfalls  and 
a  recommendation  on  avoidance  are  provided  for  each  topic. 


1.  Objectives. 


(a)  Pitfall.  Objectives  of  the  war  game  are  not  clearly  stated.  Unclear, 
unstated,  or  "sq;>arate  agenda"  objectives  often  lead  to  failed  or  irrelevant  results.  Answers 
to  questions  such  as:  why  are  we  waigaming  and  what  are  we  wargaming,  must  result  in 
specific  objectives  which  suf^rt  the  overall  T&E  effort.  The  objectives  have  to  be 
supportable  by  die  war  game  designers. 

(b)  Avoidance. 

(1)  The  objectives  should  be  stated  clearly  and  in  a  hierarchical  form, 
by  the  perstm  or  organization  sponsoring  the  total  test  and  evaluation. 

(2)  Pregame  design  meetings  should  be  conducted  between  the  war 
game  sponsor  and  the  war  game  designer.  Such  meetings  are  a  good  method  to  avoid  unclear, 
unstated,  or  "separate  agenda"  objectives.  Such  meetings  should  eliminate  or  at  least  reduce 
the  objectives  to  a  common  language  and  frame  of  reference  set  from  which  to  formulate  the 
game  design.  Results  of  these  pregame  design  meetings  should  include  a  written  set  of 
objectives. 

(3)  Insure  all  personnel  involved  in  die  war  game  know  and  understand 

the  objectives. 

2.  Appropriate  People  and  Models. 

(a)  Pitfall.  A  second  common  problem  is  the  use  of  inappropriate  gamers 
and  supporting  modeb. 


(1)  Player  Selection.  Inviting  personnel  for  Blue,  Red  and  other 
player  roles  who  lack  required  experience,  knowledge,  or  skills  can  handicqi  the  war  game. 
Surrogates  who  fail  to  do  their  principal’s  job;  or,  those  who  subven  the  war  game  by 
irresponsible  decbions  or  breaches  of  integrity;  or,  those  who  cannot  or  will  not  pursue  the 
objectives  of  the  war  game;  all  can  insure  the  war  game  does  not  meet  the  needs  of  the  game 
sponsor. 


(2)  War  Game  Tool  Selection.  Picking  an  inappropriate  model, 
computational  tool,  or  war  game  process  can  degrade  the  utility  of  a  war  game  to  support  the 
T&E  process.  Examples  of  inq>propriate  tool  selection  include:  aggregating  results  from  a 
small  unit  combat  model  like  JANUS  to  deduce  how  a  Corps  commander  would  onploy 
divbional  size  units;  or,  using  a  special  case  damage  assessment  formula  to  provide  all  damage 
results;  or,  using  a  one  sided  constrained  war  game  to  produce  insights  into  two  sided  free 
play  test  or  evaluation. 

(b)  Avoidance. 

(1)  One  solution  is  to  provide  a  professional  wargaming  facility  for 
use  to  the  community  at  large. 


70 


(2)  Another  possible  solution  is  a  thorough  pregaming  se^on  to 
identify  the  qualificadoos  of  die  players  and,  if  necessary,  train  diem  on  the  use  of  the  game. 

(3)  A  third  solution  is  to  use  pre-gaming  to  examine  die  suitability  of 

the  selected  model. 


(4)  In  determining  the  ^ropriate  people  for  the  exercise,  the  war 
game  sponsors  and  designers  should  determine  who  shall  play  and  then  get  a  C(Mnmitment 
from  diMe  people  to  play  at  the  i^ipointed  tiiiM  and  in  the  ^ipointed  role.  In  addition,  even 
widi  proper  selection  of  personnel,  there  is  usually  a  requirement  for  pregame  training  (ideally 
a  game  rehearsal)  for  players,  controllers,  and  evaluators.  The  purpose  of  die  rdiearsal  is  to 
insure  jdayers  understand  the  objectives  and  know  what  war  game  systems,  equipment,  and 
processes  will  be  different  from  what  the  players  use  in  their  day-to-^y  world. 

(5)  A  way  to  avoid  iruqipropriate  models  is  to  bring  together  the  war 
game  sponsor  and  the  war  game  designers  at  pre-test  design.  The  purpose  is  to  review,  in 
detail,  die  technical  aspects  of  what  the  game’s  organizational  and  conqmtational  processes 
are  and  what  these  processes  will  and  will  not  produce. 

3.  Perceptions  of  Results. 

(a)  Pitfall.  There  is  a  syndrome  that  'It  came  from  the  war  game  and  the 
model(8);  results  are  therefore  right,  meet  the  objectives,  and  answer  the  questions."  While 
the  war  game  may  have  produced  results  and  the  results  are  "possible"  for  the  environment, 
war  game  results  are  just  one  set  of  data  to  be  evaluated. 

(b)  Avoidance. 

(1)  Continuously  caution  all  who  are  exposed  to  the  war  game  that  the 
utility  of  the  war  game  rests  in  the  thoughts  and  insights  (issues)  it  promotes,  not  in  any 
"truths"  or  outcomes. 

(2)  A  longer  term  solution  is  to  educate  decision  makers  on  the 
capabilities  and  limitations  of  war  games. 

4.  Negative  Training. 

(a)  PitfaU 

(1)  A  potential  pitfall  that  can  have  serious  negative  consequences 
stems  from  die  use  of  models  in  a  war  game  with  insufficient  fidelity  to  support  the  game 
objectives.  In  a  training  setting  this  could  lead  to  those  being  trained  coming  away  from  the 
game  with  the  wrong  intuition  about  the  system  ciqiabilities,  i.e.,  negative  training.  This  could 
result  in  improper  decisions  in  actual  combat. 

(2)  In  a  T&E  Setting,  insufficient  model  fidelity  could  lead  to  incorrect 
inferences  about  relationships  among  systems  and  organizations.  As  the  user-friendliness  and 
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80|dustic«tion  of  systems  inqiroves  and  their  usage  in  a  T&E  setting  increases,  dieie  is  an 
added  danger  diat  the  users  of  the  system  will  become  insoisitive  to  such  pitfalls,  i.e.,  usage 
lueeds  confidence.  As  systems  becmne  easier  to  use  there  is  the  growing  potoitial  that  models 
will  be  used  by  people  who  have  not  investigated  the  models’  shortcomings. 

(b)  Avoidance.  Avoiding  this  pitfall  requires  two  parallel  courses  of  action. 

(1)  War  game  users  (including  players,  support  staff  and  the  senior 
managers)  must  systematically  view  results  for  issues  and  not  answers. 

(2)  War  games  must  augment,  not  replace,  field  testing  for  T&E. 

C.  Proper  Race  for  Wargaming  in  the  Decision  Making  Process. 

There  is  a  critical  need  for  bett^^  information  upon  which  to  base  decisions  early  in  the 
acquisition  process  as  well  as  throughout  the  cycle.  Proving  more  sound  input  early  can 
significantly  improve  the  chances  of  fielding  effective,  affordable  systems  in  a  timely  manner 
and  decrease  the  risk  in  meeting  defense  needs. 

Since  T&E  is  one  of  nuuiy  factors  entering  into  deliberations  to  proceed  to  subsequent  phases 
of  the  acquisition  cycle,  it  is  important  that  T&E  results  or  assessments  be  as  credible  and 
conq>rehensive  as  is  possible  within  constraints  imposed  by  budget  limitations,  safety 
considerations,  availability  of  test  resources,  etc.  Any  tool  that  can  provide  additional  insights 
into  die  ultimate  assessment  of  operational  effectiveness  and  operational  suitability  of  a  system 
at  a  given  milestone  decision  point  will  assist  the  decision  maker. 

Frequently,  trade-offs  can  and  must  be  made  between  operational  and  technical  alternatives  to 
meeting  requirements.  The  operational  community  charged  with  defining  requirements  may 
not  fully  understand  the  technical  options  available  and  their  respective  strengths,  weaknesses, 
limits,  and  risks.  At  the  same  time,  the  technical  community  may  not  fully  comprehend  the 
operational  basis  from  which  the  requirement  was  derived.  This  can  result  in  mismatches 
between  needs  and  solutions  which  are  not  uncovered  until  much  later,  often  not  until  OT&E. 
A  "surprise"  at  that  step  is  disroptive  and  costly.  Wargaming  provides  a  tool  to  bring  together 
the  operational  requirements  and  potential  technical  solutions  so  that  intelligent  trade-offs  can 
be  tnade  at  a  more  cost  effective  time.  The  resulting  irq>ut  in  the  decision  process  would 
certainly  be  positive. 

Wargammg  can  also  be  an  excellent  tool  for  examining  tactics,  employment  procedures,  and 
operations  concepts  for  a  new  system.  Too  often  we  leam  how  to  effectively  employ  or 
incorporate  a  new  ctq)ability  into  the  force  only  after  procurement  and  fielding.  Therefore,  a 
system’s  use  is  suboptimized  during  the  testing  process.  This  handictqjs  the  evaluation  of  the 
system’s  operational  effectiveness.  Using  wargaming  to  develop  or  examine  enq>loyment 
concepts  before  the  system  is  fielded  not  only  makes  the  fielding  a  smoother  operation,  but 
also  may  facilitate  more  accurate  judgments  of  its  ctqjabilities. 

Wargaming  when  applied  to  the  T&E  setting,  can  support  the  system  acquisition  process  in 
a  number  of  areas  and  decision  points.  In  the  concept  formulation  phase,  wargaming  can  be 
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used  to  gain  insights  into  how  a  system  will  fit  into  and  influoice  (^)erati(Hial  issues.  TIm 
focus  is  (»i  the  system’s  capabilities  fiom  an  operational,  not  technical  specification, 
perspective.  Areas  that  wargaming  would  illununate  incluite  operational  interactirms  among 
systems,  organizational  considerations  and  doctrinal  issues.  Organizatioiul  and  doctrinal 
stractures  can  be  evaluated  in  terms  of  effective  system  performance  and  the  operational 
implications  of  die  proposed  system  can  be  scoped. 

Another  level  of  decuuon  making  in  the  T&E  process  where  wargaming  could  play  a  more 
visible  role  is  in  the  test  design  and  test  planning  phases.  At  the  conclusion  of  these  phases, 
die  decision  maker  at  the  test  agency  faces  the  inevitable  trade-offs:  "How  much  field  testing 
is  enough?";  "What  ate  die  most  critical  test  issues?";  "How  do  changes  in  threat,  tactics  and 
doctrine  affect  the  outcome  of  the  tests?"  Whereas  wargaming  cannot  substitute  for  requisite 
field  testing,  it  can  contribute  significandy  by  providing  insights  to  the  test  plaimers  on  areas 
that  are  most  inqiortant  for  field  testing  and  areas  that  can  be  simulated  or  addressed  by 
analytical  tools.  It  is  at  this  level  that  wargaming  gives  the  test  planners  additional 
information  (m  which  to  base  their  decision  on  how  to  go  about  most  efficiendy  and 
effeedvely  testing  the  system. 

In  the  other  (diases  of  the  acquisition  cycle,  wargaming  can  be  used  to  augment  and 
complement  system  testing.  Operational  implications  of  the  proposed  system  can  be 
reevaluated  in  light  of  updated  system  performance  parameters  and  u^ated  threat.  In  order 
for  wargaming  and  system  testing  to  effectively  augment  and  complement  each  other,  the 
war  game  design  arid  the  system  test  must  be  carefully  crafted  to  capture  and  treat 
complimentary  issues.  This  implies  that  the  war  game  must  itself  be  reevaluated  and 
redesigned  at  each  point  of  application. 

When  operational  testing  is  conducted,  it  is  never  possible  to  replicate  "fog-of-war"  conditions. 
It  is  seldom  possible  to  replicate  all  possible  system  interactions  or  all  possible  Red  tactics  and 
doctrine  in  a  field  test.  In  these  situations  field  test  results  alone  may  be  inadequate  to  allow 
a  thorough  assessment  of  weqxrn  system  effectiveness  and  suitability.  Wargaming  can  address 
the  gq)s  in  field  data.  The  insights  gleaned  fiom  the  war  games  provide  a  more  substantive 
assessment  when  combined  with  data  fiom  other  sources.  It  is  the  ^thesis  of  insights  that 
provides  the  Defense  Acquisition  Board  (DAB)  decision  maker  with  the  information  he  needs, 
e.g.,  if  testing  is  inadequate,  if  the  system  is  inadequate,  or  if  the  decision  maker  is  not 
confident  that  test  objectives  were  met,  then  the  milestone  criteria  are  not  met. 

IV.  WARGAMING  PROCESS  EVOLUTION  RELATIVE  TO  TEST  &  EVALUATION 

TIm  projection  of  relatively  near  term  improvements  in  the  software  and  hardware  areas  hold 
omsiderable  promise  for  improving  and  expanding  the  applications  of  wargaming.  A  number 
of  possibilities  are  identified  below  along  with  a  brief  description  of  the  projected  impact  upon 
the  wargaming  community. 

•  Further  Advances  in  Computational  Power.  Advances  in  conq>uting  power  will  allow 

the  introduction  of  even  greater  fidelity  in  the  models  used  to  evaluate  player  responses. 

This  will  allow  combat  adjudication  models  to  more  closely  represent  a  combat  situation. 

Advances  in  computing  power  will  also  allow  the  player  to  get  more  riq)id  feedback  on 
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die  consequences  of  his  decisions.  The  rapid  evaluation  of  player  moves  will  allow  for 
the  simulated  time  period  to  be  extended  in  order  that  more  Irnig  term  ctmcems  can  be 
examined. 

•  Improvements  in  Simulation  Languages.  Advances  in  software  which  yield  languages 
more  ctmducive  to  simulation  modeling  will  make  models  easier  to  design,  maintain 
and  modify.  This  will  then  make  it  easier  to  respond  to  changing  game  development 
requirements.  It  will  allow  for  die  evaluation  of  systons  throughout  the  design, 
evaluation  and  procurement  phases  and  allow  updating  die  iiKxlels  as  certain  sub-systems 
comply  design  to  determine  the  effect  on  the  integrated  system. 

•  Hardware  Miniaturization.  Further  improvements  in  PC  and  Laptop  conqniters  will 
provide  sufficient  conqnitational  power  to  take  many  of  today’s  mainfraoM  bound  models 
(Ml  the  road.  This  provides  opportunities  for  more  and  better  waigaming  sujqwrt  to 
custtnners  remotely  located  from  a  major  wargaming  center.  The  ability  to  "take  the 
game  on  the  road”  is  especially  important  when  the  players  are  operational  commanders 
who  are  reluctant  to  leave  their  command. 

•  Secure  Telecommunications.  The  ability  to  play  distributed  games  to  tie  the  players 
to  a  central  unqiire  organization  will  increase  Ae  cpportunities  for  wargaming. 

•  Model  Interface  ProttKols.  The  development  of  model  interface  protocols  will  allow 
for  the  formation  of  "Federation  sets”  of  simulations.  Existing  simulatitMis  will  be 
imerfaced  to  allow  coverage  of  greater  operational  and  geogrqihic  sc(^  while  retaining 
use  of  the  individual  CINC  and  service  approved  models. 

•  Data  Bases.  Improvements  to  scalable  digitized  terrain  data  bases  will  eliminate 
reliance  on  hex-based  decision  rules;  position  and  maneuver  will  become  greater  factors, 
providing  increase  mcxiel  fidelity. 

•  Multi-level  Security.  Multi-level  secure  operating  systems  will  aUow  the  use  of  more 
real  world  automated  data  bases  and  will  provide  some  treasure  of  relief  for  war  games 
with  players  at  different  classification  levels. 

•  Secure  Teletxnnmunications  and  Standard  ProttKols.  The  ccnnbination  of  these 
technologies  will  enable  individual  combat  platform  simulators,  in  different  locaticuis, 
to  particqrate  in  the  same  sceruuio  using  the  same  terrain  and  other  common  data  base 
elements. 

•  Secure  TelectMnmunications  and  Imbedded  Training  Systems.  The  combination  of 
distributed  gaming  and  imbedded  training  systems  incorporated  in  new  weapons  systems 
offers  unique  (^^rtunities  for  wargaming  with  operatiotud  players.  Operational  players 
could  use  tiieir  own  equipment  while  control  and  the  opposing  forces  would  be  linked 
from  a  wargaming  center. 
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V.  INSIGHTS,  PERSPECTIVES,  AND  CONCLUSIONS 


Wargaming  can  iin]»ove  the  Test  &  Evaluation  process.  Providing  more  infoimaticm  and 
insights  to  die  deciskm  makers  earlier  in  the  acquisition  process  increases  the  likelihood  that 
new  weapon  systems  will  be  effective  and  suitable. 

The  area  of  wargaming  is  not  synonymous  widi  models  and  simulations.  War  games  are 
qjpropriate  where  the  human  decision  making  element  is  of  paramount  importance. 

Increased  conqMitadonal  power,  more  ttetailed  models  and  easier  to  build  data  bas^  will  not 
effect  the  fundamental  nature  of  wargaming,  which  is  a  study  in  the  social  versus  {diysical 
sciences.  The  inherent  high  variability  observed  in  war  game  outcomes  follows  direcdy  fnmi 
its  principle  strength  —  incorporation  of  the  human  element.  Thus  war  games  are  basically 
not  replicable  and  not  amenable  to  the  standard  tools  of  quantitative  analysis.  The  tools  of 
historical  analysis  are  iqipropriate  to  the  synthetic  history  provided  for  our  study  by 
wargaming. 
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APPENDIX  E 

HARDWARE  AND  SOFTWARE  TECHNOLOGY  GROUP  REPORT 


I.  INTOODUCnON 

The  hardware  and  software  technology  group  had  a  unique  agenda  among  the  groups  at  the 
MORS  Future  Wargaming  Develc^mients  Woikshop.  The  stnicture  of  this  qtpendix  follows 
this  agenda.  First,  we  discussed  current  limitations  and  problems  in  wargaming.  Second,  we 
projected  hardware  and  software  advances  and  oqtabilities  over  the  next  5-10  years.  Third, 
we  examined  how  diese  advances  in  hardware  and  software  technologies  could  be  applied  to 
solving  some  of  the  currem  problems  in  wargaming  simulations.  To  illustrate  how  technology 
might  be  applied  to  war  game  simulation  problems,  several  DOD  programs  were  presented  by 
their  tespecdve  representatives  at  die  workshc^.  These  programs  include:  Distributed 
Wargaming  System,  SIMNET,  JANUS,  Theater  Analysis  Model,  Battle  Command  Training 
Program  (BCTP)  ASSETS,  and  the  AirLand  Biutle  Management  (ALBM)  System  Heuristic 
Command  Evaluator. 

We  recognized  that  advances  in  hardware  and  software  technology  will  not  solve  all  the 
current  problems  and  limitations  in  wargaming.  Continuing  problems  were  enumerated  and 
discussed.  Finally,  we  drew  some  conclusions  about  wargaming  and  the  opportunities  for 
hardware  and  software  advances  and  made  near-term  and  longer  range  recommendations  for 
DOD  acti<m  and  research. 

n.  CURRENT  UMITATIONS/PROBLEMS  IN  WARGAMING 

A  variety  of  problems  and  limitations  with  current  war  games  and  simulations  were  discussed 
and  organized  into  four  major  categories:  modifiabilityAnaintainability,  reliability/  efficiency, 
resolution,  and  intensive  personnel  requirements. 

A.  Modifiability/Maintainability. 

1.  Technical  Suppon  is  Expensive  or  Not  Available.  Many  current  war  game 
suites  require  technical  su{^rt  which  is  both  costly  and  hard  to  obtain.  In  some  cases,  these 
war  games  were  first  created  using  hardware  and  software  versions  which  are  no  longer 
manufactured  and  often  no  longer  supported,  exce|n  for  their  continued  use  in  the  respective 
war  games.  They  are  labor  intensive  to  run,  and  often  the  hardware  is  not  physically  portable 
without  significant  cost. 

2.  Lack  of  Software  Portability.  Current  computerized  war  games  are  usually 
written  in  machine  qiecific  software,  i.e.,  software  which  is  not  portable  to  new  or  different 
types  of  hardware  w^out  substantial  recoding.  The  investment  money  spent  in  creating  these 
war  games  thus  becomes  an  investment  which  carmot  be  utilized  for  newer  equipment.  Multi- 
tnillitm  dollar  expenditures,  plus  substantial  investments  in  time  and  manpower,  would  need 
to  be  repeated  in  recreating  war  games  with  similar  cq>abilities. 
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3.  Ovenue  of  Pnqirietaiy  Systems.  The  absence  of  a  mass  market  for  DOD  war 
games  hu  meant  diat  most  vendors  have  created  and  designed  the  war  games  they  provide 
to  DOD  by  using  die  hardware  which  they  possess,  either  mainframes  or  mini-con^Hiteis,  and 
the  software  widi  which  diey  are  most  familiar.  This  often  means  that  die  contractor  becmnes 
the  long-term  sole  source  provider  of  maintenance  and  modifications  for  this  war  game.  In 
sddhinn,  it  also  locks  DOD  into  using  not  only  equipment  firmn  a  qiecific  vendor,  but  also 
qiecific  (and  obsolescent)  hardware  from  that  vendor. 

4.  Data  Base  Building  is  Labor  Intensive.  CtHistructitm  and  utilization  of  data 
bases  to  support  war  games  involves  major  expense  in  time  and  marqxiwer.  This  includes 
effort  to  research,  populate,  and  validate  d^  data  elements  ctnnprising  a  data  base.  This 
jnecludes  rqiid  develtqmient  or  alteration  of  wargaming  scenarios  and  objectives  that  require 
new  or  revised  data  records.  War  games  diat  can  and  should  be  easily  modifiable  to  explore 
alternatives  become  significant  efrbrts  in  and  of  themselves  merely  in  the  construction  phase, 
war  games  that  eiqilore  new  technology  will  require  new  data  descriptors.  These  descr^ors, 
in  turn,  will  require  research,  schema  modification,  population,  testing,  and  will  inq>act 
q^lication  programs  in  many  of  the  major  systems  in  use  today. 

5.  Hardware  Interface  Standards  Are  Not  Conq>rehensive.  Numerous  war  game 
systons  exist  that  cannot  easily  be  ported  to  other  internal  departmental  agencies,  as  well  as 
extenud  agencies.  Most  often,  systems  were  developed  for  a  unique  machine  envinmment 
to  take  advantage  of  that  machine’s  performance  and  capabilities.  Different  machine  platforms 
cannot  accommodate  foreign  systems  without  some  redesign  and  nuxlification,  and,  in  nuuiy 
cases,  not  at  all.  This  poses  problems  in  that  the  man-in-the-loop  most  often  becomes 
preoccupied  in  establishing  the  human  interface,  periu^  manually  taking  the  output  from  one 
system  and  manually  inserting  into  another. 

6.  War  Game  Data  Interface  Standards  Are  Needed.  The  communication  of  data 
between  war  game  devices  and  systems  caiuiot  be  facilitated  unless  these  devices  and  systems 
are  capable  of  ’speaking’  to  each  other,  or  shaking  hands.  Without  interface  standards  to 
establi^  this  handshaking,  machine-to-machine  and  war  game-to-war  game  transfer  of  data 
is  limited  not  only  by  incompatible  software  and  hardware,  but  also  by  the  tools  available  to 
software  engineers  to  overcome  the  basic  inability  of  machines  speaking  to  each  other. 
Resolution  of  titis  problem  has  intact  on  other  elements  of  incompatibility  besides  data 
conunuitications,  namely,  hardware  and  software. 

B.  Reliability/Efficiency. 

1.  Hardware  Incompatibility.  The  wide  variety  of  non-commuiticating  hardware 
sets,  which  are  in  essence  stand-alone  ami  independent  systems  that  do  not  commimicate  with 
one  another,  is  a  major  limitation  in  current  wargaming.  The  impact  of  this  limitation  is 
pervasive,  idfecting  virtually  every  comer  of  the  warganung  cmmnunity.  Users  are  denied 
the  use  of  well-designed  games,  which  would  otherwise  assist  them  in  nreeting  tiieir  objectives, 
because  they  do  not  have  the  correct  hardware  to  run  the  game.  Not  only  is  productivity  of 
the  potential  user  constrained  because  he  cannot  use  the  game,  but  the  contribution  of  the  new 
user,  in  terms  of  game  inqnovements,  is  also  lost.  Thus,  hardware  incompatibility  tends  to 
degrade  the  ciq>abilities  of  the  wargaming  community  as  a  whole. 
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2.  Aging  Equqxnmt  Base.  This  difficulty  affects  a  laige  segmoit  of  the  war 
game  community.  The  initial  monetary  and  resource  investmoit  required  for  major  gaming 
systems  (major  systems  are  defined  as  requiring  an  initial  investment  of  ten  million  dollars  or 
more)  temb  to  make  future  hardware  and  software  upgrades  difficult.  Indeed,  the  initial 
investment  costs  seem  so  large  as  to  ctuistrain  improvanents  of  systems,  regardless  of  whether 
they  were  successful  or  unsuccessful  in  meeting  dieir  develt^xnent  objectives.  The  inqiact  of 
diis  failure  to  upgrade  hardware  and  software  results  in  aging  equipmem  suites  which  do  not 
keep  pace  witfi  petfonnance  demands.  The  following  list  includes  exatiqrles:  games  that  do 
not  run  as  fast  as  diey  would  on  new  equipmem;  games  that  cannot  talm  advantage  of  new 
gnq)hic8  techniques;  games  that  do  not  use  improved  software  utilities;  or  games  dut  cannot 
capitalize  on  mass  storage  systems.  In  this  environment,  war  games  are  not  as  good  as  they 
slKMild  be.  The  aging  equqmimt  base  is  linked  to  the  fact  that  procurement  of  major  systems 
is  a  long  term  process,  which  is  stretched  out  evoi  further  when  budget  dollars  are  lifted. 

3.  Networic  Systems  Run  Too  Slowly.  The  introduction  of  networks  into  the 
wargaming  envirmunent  luu  led  to  greater  flexibility  by  allowing  greater  numbers  of  players 
to  partic^te.  There  is,  however,  growing  evidmce  that  the  exchange  of  information  bt^een 
nodes  takes  too  much  time.  This  problem  becomes  critical  in  games  which  are  requited  to 
run  at  real  time  or  faster.  This  run  time  constraint  results  in  the  establishment  of  an  artificial 
limit  on  the  size  of  selected  games  which  are  used  to  stress  real  operational  staffs  on  a 
real-time  basis. 

4.  Life-Cycle  Maintenance  Is  Not  Part  Of  System  Design.  Many  of  the  automated 
games  and  gaming  systems  in  use  today  were  not  developed  under  a  life  cycle  maintenance 
discipline.  Indeed,  most  of  these  systems  have  been  developed  incrementally  aiul  represent 
the  epitome  of  what  is  referred  to  as  "spaghetti  code."  This  situation  causes  several  problems. 
First,  some  code  is  so  obscure  that  the  owner  does  not  know  what  it  does.  Surprising  though 
h  nuiy  be,  this  code  continues  to  be  used  in  die  game,  because  the  overall  game  qiparently 
behaves  in  a  reasonable  manner.  Second,  modifications  to  the  code  or  data  base  are  difficult, 
time  consuming,  and  dangerous  to  continued  reasonable  results.  Third,  the  code  is  in  general 
not  portable.  Fourth,  documentation  is  either  nonexistent  or  limited  and  in  the  latter  case  not 
up  to  date.  Finally,  assuming  that  the  old  code  remains  in  use,  it  is  virtually  inqxissible  to 
forecast,  in  any  reasonable  way,  the  cost  of  maintaining  and  updating  the  system  in  the  future. 

C.  Resolution. 

1.  Credibility  Versus  Fidelity.  Currently,  wargaming  is  limited  by  our  ability  to 
manage  the  volumes  of  detail,  to  define  the  level  of  fidelity  and  to  present  a  spectrum  of 
reality.  Our  ability  to  obtain  and  update  large  volumes  of  detailed  data  in  a  regular  and 
reqxmsive  tiuinner  is  limited  by  man-machine  and  software  interfaces,  multiple  security 
classification  levels,  and  single  purpose  data  sources.  The  level  of  data  detail  designed  in 
the  game  is  normally  dictated  by  fte  fidelity  specified  by  the  user  without  regard  for  other 
uses  or  available  data  sources.  For  example,  a  game  designed  to  help  commanders  understand 
some  of  the  consequences  of  various  tactics  of  current  systems  would  require  detailed 
pofoimance  characteristics  that  may  not  be  available  if  used  to  identify  possible  tactics  of 
prototype  oompartmented  systems.  Tlie  same  game  used  to  gain  insights  into  tactics  not 
currently  planned  may  require  totally  different  detailed  performance  data  on  all  systems  (data 
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that  may  not  exist).  If  tbe  dtta  exists,  it  is  often  not  in  a  foim,  foimat  or  at  a  classification 
level  diat  pennits  direct  transfer  into  the  current  data  base.  Many  of  die  data  limitations  could 
be  overcome  improved  man-machine  interfaces,  standard  software  interfaces  and  standard 
df**  aootoes.  In  addition  to  die  hardware  and  software  limitations  addressed,  die  security 
ptoUems  (multi^  levds)  will  Umit  gaming  until  a  method  of  safely  filtering  classified  data 
can  be  developed,  or  multi-level  {nocessing  can  be  implemented. 

Mat^  users  require  diat  game  fidelity  (data)  go  far  beyond  diat  necessaiy  to  be  credible  for 
a  given  training  objective.  One  solutitxi  appears  to  be  die  addition  of  detail  to  explain 
conqilex  interactions  so  diat  die  user  diinks  he  understands  the  behavior.  Anodier  problem 
occurs  ^rfien  detailed,  complex  interactituis  are  condensed  and  the  user  is  no  Icmger  confidoit 
diat  all  results  are  credible  given  diat  the  process  has  been  aggregated.  He  can’t  see  how  die 
result  was  obtained.  In  snne  cases  when  availidile  data  is  used  to  derive  aggregated  soluticuis, 
the  results  may  qipear  credible,  but  may  in  fact  be  in  error.  Solutions  to  die  credibility  versus 
fidelity  issue  may  be  partially  sidestepped  by  better  data  base  interfaces.  However,  until 
methods  are  developed,  proven  and  accepted  duit  permit  valid  condensatitui  of  detailed  systons 
data,  die  trade-off  and  limitaticuis  of  fidelity  versus  credibility  will  c<»itinue  to  exiA. 

2.  Artificialities  Impact  Learning.  Data  and  process  limitations,  alrmg  with  time 
and  material  limitarirms,  may  result  in  artificialities  which  seriously  limit  wargaming  and  may 
have  an  inqiact  cm  learning.  Users  may  come  to  believe  diat  the  spectrum  of  possible  reality 
has  been  experienced  in  the  series  of  war  games,  and  that  there  are  none  possible  outsirte 
diose  experienced  in  the  games.  This  limitation  is  normally  manifest  in  system  simulators 
where  users  tend  to  believe  that  the  simultuor  behaves  exactly  like  the  real  system  and  that 
the  full  ^lectnim  of  possibility  can  be  simulated.  War  games  cannot  currendy  and  probably 
will  never  be  able  to  presoit  the  complete  ^ctnim  of  reality.  The  best  die  game  can  do  is 
place  the  user  in  an  environment  within  which  he/she  can  test  possible  solutions  to  the  given 
problem.  This  limitation  may  be  minimized  by  exposing  the  user  to  many  varied  games  and 
making  sure  users  understand  this  limit  of  wargaming. 

D.  Intensive  Maiqiower  Requirements. 

The  nature  of  die  wodc  requires  technical  staff  of  the  highest  standards.  A  permanent,  highly 
specialized  technical  staff  is  required,  as  well  as  large  man  hour  investments  prior  to  each  war 
game  with,  unfortunately,  often  poor  transferability  of  required  data  to  other  war  games  even 
at  the  same  utility.  Ex^rienced  highly  specialized  technicians  are  difficult  to  hire  and  retain 
in  civil  service,  sometimes  inqxissible  without  permanent  contractor  assistance. 

1.  Data  Base  Creation  And  Maintenance  Is  Time-Consuming  and  Expensive.  Data 
base  ciHistructitm  and  utilization  to  support  war  games  involves  considerable  expense  of 
resources,  e.g.,  time  and  manpower.  This  includes  effort  to  research,  populate,  and  validate 
the  data  elements  conqirising  a  data  base.  It  precludes  rapid  development  or  alteration  of 
wargaming  scenarios  and  objectives  that  require  the  manual  nature  of  updating  flat  files,  the 
lack  of  useful  tools,  the  inal^ty  to  crpitalize  on  comrrxm  attributes  of  military  systems  used 
in  differem  theaters  of  war. 
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2.  Connectivity.  Numerous  war  game  systems  exist  duu  cannot  easily  be  potted 
to  odier  internal  departmental,  as  well  as  external  agencies.  Most  often,  systems  were 
developed  for  a  unique  nnirhifi#>  envitonmoit  to  take  advantage  of  diat  machine’s  performance 
and  oqrabilities.  Most  machine  platforms  cannot  accmrurrodate  foreign  systems  without  some 
redesign  and  modification  and,  in  many  cases,  not  at  all.  This  poses  problems  in  that  die 
man-in-die*loop  most  often  mds  up  being  required  to  establish  the  human  interface,  perhiqis 
taking  die  ouqiut  from  (me  system  and  manually  entering  it  into  another. 

The  communication  of  data  between  devices  and  systems  cannot  be  facilitated  unless  these 
devices  and  systems  are  capable  of  ’speaking*  to  each  other.  Without  a  communications 
protocol  to  establish  this  hflnd.^alfing,  machine-to-machine  transfer  of  data  is  limited  not  (mly 
to  inomqiatilde  software  and  hardware,  but  to  the  technical  capability  of  software  engineers 
to  ovoocome  the  basic  inability  of  machines  speaking  to  each  othn.  Resoluticm  of  this 
problem  has  inqiact  cm  other  elements  of  incompatibility  besides  communicaticms,  namely, 
hardware  and  software. 

3.  Human  Interface.  The  human  interface  limitations  of  existing  war  game  systems 
can  be  divided  into  two  broad  categories:  (1)  development/set-up  interface,  and;  (2)  player 
interface.  Current  systems  require  great  amounts  of  time  and  training  effort  to  iiqMit 
commands  and  interpret  game  response.  The  level  of  detail  available  to  the  players  in  both 
status  and  giiqihics  displays  can  cause  confusion  and  loss  of  valuable  information. 
Additionally,  die  iKHi-starulard  symbols  used  in  some  games  provides  further  confusion  and 
resultant  loss  of  player  interest  and  confidence. 

The  game  development/set-up  jdiase  of  a  large  game  may  require  weeks  (months  in  some 
cases)  of  skilled  effort  for  data  base  input,  test  and  verification.  Scenario  development  takes 
additional  time  and  effort  in  line  by  line,  system  by  system  input  and  testing.  The  current 
process  has  the  potential  of  inducing  errors  that  will  not  be  caught  until  play  commences. 

Player  interface  during  game  play  consists  of  command  input  and  status/graphics  output. 
Extensive  training  is  required  for  the  players  to  become  comfortable  with  the  commands  and 
to  provide  an  ad^uate  response  to  changing  tactical  situations.  The  alternative  to  extensive 
player  training  is  dedicated  facilitators  which  is  an  expensive  drain  on  scarce  resources. 

m.  HARDWARE  AND  SOFTWARE  ADVANCES  IN  THE  NEXT  5-10  YEARS 

The  technology  advances  which  will  have  an  inqiact  on  the  development  and  conduct  of  war 
games  in  the  next  5-10  years  have  been  organized  into  several  categories:  hardware, 
communications,  software,  and  human/machine  interfaces.  These  technology  advances  along 
with  their  effects  on  wargaming  are  described  below. 

A.  Hardware  Advances  Affecting  Wargaming. 

There  will  continue  to  be  orders  of  magnitude  increases  in  processing  power  coupled  with 
decreases  in  the  footprint  of  hardware  available.  The  per  dollar  cost  of  N^S  should  continue 
to  decrease.  Therefore,  the  availability  of  powerful,  compact  hardware  at  reasonable  prices 
should  no  longer  constrain  or  limit  the  development  of  war  game  capabilities.  War  game 
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pCDponents  and  developers  will  be  able  to  focus  on  the  "real"  lequiranents  for  war  games. 
Hardware  developers  will  lode  for  new  opportunities  to  increase  emt^ting  power  and  the 
efficiency  of  qjplication  juocessing  within  the  size  envelc^.  One  of  the  pnmiising  areas  is 
biological  hardware  where  the  goal  is  to  harness  the  brainpower  of  other  species  able  to 
efficiently  perfcmn  tasks  which  we  have  failed  to  adequately  model  in  our  hardware  and 
software.  An  exanq>le  would  be  to  tq>  the  brains  of  pigeons  to  perform  visiem  processing. 

B.  Communications  Advances  Affecting  Wargaming. 

1.  Unlimited  Bandwidth  Technology.  Advances  in  communications  technologies 
during  the  next  5  to  10  years  will  eliminate  most  of  the  current  local  ctmununications 
limitations  experienced  in  wargaming.  Local  networks  will  qjproach  unlimited  bandwidths 
through  the  use  of  fiber  optic  technologies.  This  technology,  which  has  been  expanding  in 
all  communications  applications,  will  eliminate  nearly  all  of  the  bandwidth  constraints  within 
the  fiber  networks. 

2.  Local  Area  Networks  Becoming  Wide  Area  Netwodcs.  Local  networics  will  be 
redefined  as  the  expanded  use  of  fiber  optic  technology  throughout  the  entire  tele¬ 
communications  arena  becomes  a  completed  reality.  A  local  network  will  expand  from  the 
physical  environment  of  a  building  to  a  coast-to-coast  geognq>hical  environment  with  the 
possibility  expanding  beyond  the  limits  of  the  coasts. 

As  the  definition  of  a  network  approaches  the  limits  of  fiber  optic  technology,  all  digital 
communication  data  (data,  voice  and  video)  will  move  within  the  new  coast-to-coast  networks 
with  modem  switching.  Long  haul  communications’  limitations  outside  of  fiber  optics  will 
remain  with  the  wargaming  community.  This  limiting  factor  will  impact  the  architecture  of 
current  and  future  designs.  It  is  expected  that  overaU  the  improvements  will  reduce  the  data 
exchange  delays  experienced  by  roughly  50%  over  the  next  10  years. 

C.  Software  Advances  Affecting  Wargaming. 

The  wargaming  community  is  faced  with  three  classes  of  software  related  problems.  First,  a 
multitude  of  different  programming  languages,  war  game  models  and  data  bases  exist,  most 
of  which  do  not  interface  with  each  other.  Second,  programming  is  technically  demanding 
hard  and  war  game  users,  the  domain  experts,  are  rarely  also  expen  programmers.  And 
finally,  there  does  not  exist  a  taxonomy  of  war  game  systems  to  draw  on  in  building  new 
systems.  Three  trends  in  software  technology  indicate  that  developments  will  occur  to  solve 
these  problems. 

1.  Higher-Level  Languages.  Not  only  have  we  seen  the  development  of  languages 
aimed  towards  difierent  progratiuning  regimes  (e.g.,  FORTRAN  and  ALGOL  for  math  and 
COBOL  for  business),  but  we  have  also  seen  concepts  directly  supponed  within  diese 
languages  (e.g.,  set  theory).  Furthermore,  there  are  alternative  environments  such  as 
spreadsheets  aimed  at  budgeting  and  financial  applications.  These  are  the  first  steps  in  concept 
based  languages  aimed  at  domains  of  knowledge  with  greater  or  lesser  breadth.  It  is  likely 
that  one  or  more  concept  based  languages  will  be  developed  for  wargaming  using  modem 
techniques  such  as  object  oriented  prograrruning. 
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second,  there  are  knowledge  based  languages  with  their  own  built-in  gn^jhic  editms.  This 
trend  is  aimed  at  providing  systems  duu  donain  experts,  not  expert  prograituners,  can  use  to 
iiqwt  data  to  build  and  modify  data  bases. 

Third,  there  has  bear  progress  on  automatic  translaticm  from  (me  programming  language  to 
another.  Ccmtinued  progress  will  help  reduce  the  cost. 

These  trends  are  leading  towards  a  hierarchical  system  of  domain  qiecific  languages  which 
aici9)sulate,  with  hardware  support,  domain  concq>ts  as  basic  programming  blocks.  At 
maturity,  these  hierarchies  deal  explicitly  with  interfacing  between  languages  and  between 
models  built  in  the  same  (and  different)  languages.  Different  levels  of  resoluticm  (in  war  game 
models  for  exan^le)  will  be  dealt  with  by  mcxlels  being  built  in  languages  at  different  levels 
of  the  hierarchy.  For  exan^le,  a  sub-hierarchy  of  war  game  languages  would  be  used  to 
interface  arbitrary  current  war  games  and  mcxlels,  such  as  the  Distributed  Wargaming  System 
and  SIMNET,  and  to  build  totally  new  future  war  games. 

2.  Software  Engineering  Advances.  Currently,  all  areas  of  software  engineering 
have  problems.  Docurtrentation  of  war  games  (as  any  otlrer  system)  is  poor  or  non-exist«it, 
out  of  date,  or  prohibitively  expensive.  Maintainability  and  modifiability  problems  cause  added 
expense  aixl  poor  use  of  the  systems.  Optimized  c(xle  beconres  inqmssible  to  read  or  nuxlify. 

There  are  several  trends  in  software  engineering  which  offer  help.  New  compilers  include 
automatic  error  checking  and  optimization.  Developments  in  programming  environments  are 
proving  themselves  by  sui^rting  rapid  prototyping.  The  software  engineering  aspects  of  Ada 
are  proving  valuable  as  a  base  for  developing  automated  engineering  tools. 

In  the  future,  software  engineering  advances  will  be  applied  to  the  development  of  war  games. 
For  example,  design  languages  and  associated  user  support  t<x>ls  will  be  used  to  ^recify  war 
game  systems.  Outputs  from  programs  written  in  these  languages  will  be  implementation  level 
c(xle  in  the  language  specified  by  the  war  game.  Reverse  engineering  tools  will  be  available 
to  automatically  generate  readable  code  and  documentation  from  optimized  code.  Automatic 
documentation  and  explanation  will  be  based  on  advances  in  natural  language  processing  and 
text  generation. 

3.  Adqitive  Systems.  War  game  systems  (as  others)  are  unresponsive  to  changes 
in  requirements  and  environments.  Hand  tuning  is  too  slow  and  labor  intensive.  Machine 
learning  technologies  (Similarity  Based  and  Explanation  Based  Learning),  stcKhastic  search 
techniques  (simulated  annealing  and  genetic  algorithms),  and  neural  net  technology  all  form 
the  basis  for  adaptive  systems  under  the  control  of  human  domain  experts.  Problem  solving 
will  become  a  science,  with  its  own  concept  based  language  and  hardware  support  embedded 
in  war  game  simulation  systems. 

D.  Human/Machine  Interface  Advances  Affecting  Wargaming. 

There  are  potential  advances  in  human/machine  interface  capabilities  which  should  both  allow 
humans  to  more  easily  and  effectively  participate  in  war  games  and  to  better  understand  the 
cause  and  effect  relationships  which  influenced  the  course  of  the  game  and  its  results. 
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1.  Grqjhics.  High  resolution  graphics  is  already  a  reality  for  ctanputer  generated 
digital  images.  The  move  of  video  from  analog  to  digital  (Mocesses  for  recmding, 
transmission,  and  di^^y  of  images  will  facilitate  integration  of  dicM  images  with  computer 
generated  di^ays  on  the  same  hardware.  This  will  allow  face  to  face  exchanges  b^ween 
people  at  distant  locations  as  games  are  in  progress  while  simultaneously  sharing  cmnputer 
generated  information.  Digitally  recorded  vi»ial  informaticm  tm  locations,  equqanent,  pet^e, 
etc.,  can  be  integrated  with  computer  generated  game  information. 

2.  Voice  Recognition.  Con^uter  synthesized  voices  are  a  current  reality. 
Computer  voice  recognition  is  progressing  quickly.  Sounds,  words,  sentences  and  the  meaning 
of  vocal  inflectitnis  can  be  recognized  and  acted  upon  by  conqHiter  systems.  In  the  future, 
these  process  should  be  refined  enough  so  that  war  game  conqniter  processes  which  now 
require  typed  ii^t  should  be  able  to  respond  to  voice  commands.  This  will  simplify 
interfaces  and  make  die  computer  more  responsive  to  the  needs  of  the  game  particqiant. 

3.  Self-Tailoring  User  Interfaces.  There  are  currendy  software  packages, 
particularly  for  personal  computer  systems,  which  allow  a  user  to  tailor  the  system  to  his 
preferred  way  of  operating.  In  the  near  future,  software  will  Team"  how  a  user  operates  and 
adapts  itself  to  be  most  responsive  to  the  particular  user’s  needs.  For  exanqile,  some  users 
are  more  comfortable  typing  input  to  a  conputer  while  others  may  be  more  comfortable  with 
voice  input.  Adiqitable  software  will  be  able  to  respond  to  either  style  or  some  mix  of  the 
two.  In  addition  to  adapting  to  the  style  of  interface  preferred  by  a  user,  an  adrqitive  user 
interface  should  be  able  to  adtqit  to  the  kinds  and  way  in  which  users  want  presentation  of 
information.  For  example,  one  user  may  want  to  know  about  unit  locations  and  relationships 
and  he  wants  to  see  this  displayed  on  a  map.  An  adaptive  system  would  recognize  this  and 
provide  the  information  in  this  way  on  request,  without  the  user  having  to  work  his  way 
through  multiple  levels  of  menus  or  know  a  string  of  commands. 

4.  Physiological  Kinematic  Interfaces.  Currendy,  many  different  types  of  manual 
interfaces  exist.  Obvious  ones  are  the  keyboard,  number  pads,  joy  sticks,  graph  tablets  and 
the  ubiquitous  mouse.  Not  so  common  are  gloves  which  track  the  position  and  actions  of 
hands  and  fingers  and  helmets  which  track  the  position  of  head  and  eyes  as  input  to  computer 
processes.  These  may  be  useful  if  they  simplify  interfaces,  improve  responsiveness  and/or 
improve  the  understanding  of  the  war  game  participant. 

5.  Other  Interfaces.  Further  out,  the  possible  use  of  electrodes  and  probes  should 
be  explored.  Scientists  are  using  probes  to  understand  how  brains  work.  As  an  interface, 
probes  may  allow  computers  to  respond  to  thoughts  or  to  direcdy  conununicate  an  idea  or 
image  to  the  user. 

rV.  EXAMPLES  OF  WARGAMING  APPLICATIONS  EXPLOITING  NEW  HARDWARE 
AND  SOFTWARE  TECHNOLOGY  ADVANCES 

There  are  a  number  of  war  game  and  simulation  programs  which  are  exploiting  advances  in 
software  and  hardware  technology  to  various  degrees.  Representatives  from  several  of  these 
programs  were  members  of  the  Hardware  and  Software  Technology  Group.  These  programs 
are  described  in  the  following  sections. 
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A.  DARPA’s  DWS  and  Exercise  ACE  89. 


DARPA's  Distribute  Wargaming  System  (DWS)  was  an  extremely  rapid  prototyping  (18 
months)  of  a  number  of  improvonents  in  the  training  usage  of  waigaming.  The  program 
distributed  iiputs  and  ouputs  from  an  existing  collection  of  nuxlels  maintained  by  the  Warrior 
Prq>aration  Center  (WPC)  in  Einsiedlerhof,  Germany.  The  WPC  primarily  used  as  a 
Corps  Commander  training  system,  providing  the  commander  and  his  staff  with  training 
against  a  living,  thinking  Red  oiponent. 

On  19  November  1989,  DARPA  conpleted  the  (TINCEUR  Exercise  ACE  89,  which  irKluded 
particpatitm  by  SACEUR  and  the  ACE  Major  Comnuuids  AFCENT,  AFSOUTH  and 
AFNORTH;  Cratral  Regicm  subordinate  commands  down  to  corps,  ATCX^  and  SOC  levels;  and 
HI  Corps  frcrni  their  in-garrison  location  in  the  CX>NUS.  Du^g  the  exercise,  participating 
ctmimands  located  at  18  separate  geographical  locations  in  England,  Belgium,  Holland, 
Germany,  Norway,  Italy,  and  Texas  were  linked  together  through  DARPA  developed  DWS 
ctmiputer  networking  technologies  that  provided  each  remote  node  of  players  with  a  computer 
generated  artificial  wartime  envirorunent  and  Video  Teleconferencing  Capability  (VTC). 

The  results  of  the  ACE  89  DWS  experiment  were  remarkable.  They  represent  a  major 
breakthrough  in  providing  realistic  wartime  training  for  senior  US  and  Allied  (Tonunanders  and 
their  Staffs.  DWS  provided  a  better  and  less  expensive  way  to  train  commanders  and  staffs 
by  bringing  all  of  them  together  at  the  same  time  in  a  r^istic  wartime  scenario  at  their 
wartime  locations  without  having  to  go  through  long  DOD  and  Allied  peacetime  planning 
processes.  Two  major  observations  were: 

•  The  exercise  offered  unique  training  opportunities  in  the  art  of  coalition  warfare. 
Through  DWS,  SACEUR  and  the  SHAPE  Staff  were  able  to  direct  simultaneous  banle 
management  operations  with  all  major  ACE  subordinate  commanders  and  their  staffs 
under  conditions  that  would  exist  in  general  war.  It  also  provided  keen  insights  into 
how  a  Supretire  Commander  would  deal  with  his  subordinates  in  reaching  strategic 
decisions  regarding  theater  strategy  and  allocation  of  resources. 

•  The  value  of  real  world  C^  systems  that  include  VTC  is  very  high.  During  die 
exercise,  the  face  to  face  contact  between  SACEUR  and  his  subordinate  commanders 
enhanced  their  understanding  of  ongoing  operations  and  significantly  improved 
coordiruuion  of  theater  battle  management  issues.  The  software-controlled  VTC  system 
designed  by  DARPA  permitted  simultaneous,  NATO  Secret,  full  duplex  conferences  of 
2  to  20  commanders. 

The  impact  on  die  wargaming  community  from  the  implementation  of  the  DWS  prototype, 
including  the  following  points: 

•  DWS  provided  the  framework  to  expand  the  training  audience  from  the  Corps  to 
Echelons  Above  Wing/Corps  with  the  players  playing  at  their  wartime  locations. 
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•  Tactical  cmnmunications  systems  were  in  use  above  leqxHise  cell  level.  Data  and 
communications  below  the  player  level  were  handled  within  the  DWS  system  at  the 
NATO  secret  level. 

•  ACE  89,  using  the  DWS,  allowed  the  combination  of  multiple  levels  and  types  of 
war  games. 

•  The  beginnings  of  an  id)ility  to  run  global  wargaming  through  the  use  of  a  DWS  to 
link  model  and  con^ting  centers  with  the  players.  However,  this  also  demtmstrated 
the  need  for  standard  wargaming  interfaces  and  protocols. 

The  next  step  in  the  DWS  development  process  is  to  turn  the  system’s  hardware,  software  and 
networking  technologies  over  to  an  qjpropriate  DOD  Executive  Agent  to  assure  that  its 
maximum  ciq>ability  is  used  in  future  US  and  Allied  training  programs.  In  this  connection, 
we  believe  the  system  offers  great  potential  for  future  training  of  executive  level  commanders 
and  that  it  should  be  expanded  to  include  global  scenarios  with  simultamous  partic^ation  by 
the  Unified/Specified  Commanders  and  Service  Chiefs.  DARPA  will  continue  to  investigate 
the  standard  wargaming  interface  and  protocol  issues. 

B.  Battle  Command  Training  Program  -  ASSETS. 

The  Batde  Command  Training  Program  (BCTP)  based  at  Fort  Leavenworth,  Kansas,  is  one 
of  the  Army’s  four  Combat  Training  Centers,  and  is  devoted  to  training  unit  commanders 
and  their  sti^  in  the  command  decision-making  process.  ASSETS  (Army  Simulation  Support 
Expert  Tools)  is  an  effort  to  sqrply  expert  systems  technology  to  training  simulation  support. 
In  particular,  ASSETS  is  focus^  on  Opposing  Force  (OPFOR)  operations,  a  staff  intensive 
suj^tt  function.  BCTP’s  goal  is  to  develop  a  cost-effective,  world-class  OPFOR.  The 
ASSETS  proof-of-concept  prototype  was  developed  using  knowledge  ragineering  and  rapid 
prototyping  techniques.  ASSETS  incorporates  Soviet  doctrine  for  maneuver  and  fire  support, 
and  provides  a  powerful  user  mterface  and  significant  increases  in  automation.  ASSETS  is 
link^  with  the  Joint  Exercise  Support  System  (JESS)  simulation.  ASSETS  obtains  data  about 
the  current  battlefield  situation  from  J^S,  and  also  sends  orders  to  JESS,  for  example,  to 
maneuver  units  and  to  perform  fire  missions. 

C.  Janus  War  Game. 

Janus  is  a  closed,  two  sided,  stochastic,  ground  maneuver  war  game  with  attrition  resolution 
to  the  system  level  (tank,  armored  persormel  carrier,  soldier,  artillery  piece,  etc.).  It  is  cqrable 
of  gaming  forces  up  to  brigade  versus  regiment  using  from  one  to  as  many  as  eight  gamers 
interactively  controlling  the  systems.  There  are  two  similar  but  separate  versions  of  Janus. 
One  is  developed  and  supported  by  Lawrence  Livermore  National  Laboratory,  the  creator  of 
the  original  game.  The  other  is  developed  and  supported  by  the  TRADOC  Analysis  Command 
CTRAC),  the  first  Army  user  of  Janus. 

To  overcome  many  of  the  limitations  attributed  to  computer  assisted  war  games  and  software 
in  general  in  the  areas  of  modifiability,  reliability,  efficiency,  and  understandability,  the 
development  team  has  adhered  to  the  principles  of  software  engineering.  Combining  these 
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princ^es  with  the  ability  to  cleaily  write  mathematic  and  logic  algoridims  in  FORTRAN  and 
rigorously  commenting  has  result^  in  well  stnictured,  understandable  code  which  can  be 
quiddy  and  easily  enhanced.  The  team  also  uses  the  concept  of  rapid  prototyping  to  develq> 
and  test  potoitial  algorithms.  The  technique  of  reusable  code  is  applied  extensively  to  speed 
code  developnmit. 

Conqmter  assisted  war  game  limitations,  frcnn  the  user’s  per^ctive  in  the  areas  of 
responsiveness,  understandability  and  credibility,  have  been  dealt  with  by  die  extensive  use  of 
interactive  conqiutational  techniques  and  the  high  resolution  color  grtq^cs.  It  is  the  belief 
of  the  development  team  that  the  most  valuable  resource  in  any  war  game  is  the  maiqiower 
involved:  develtqiers,  gamers,  analysts,  and  the  users  of  the  results.  Extensive  use  of  menus 
and  fiU-in-the-blank  tables,  guide  users  through  data  base  development  and  managonoit,  game 
set-up,  game  play  and  post  processing  of  results.  The  use  of  high  resolution  graphics  allow 
both  analysts  running  the  game  and  users  of  the  game  results  to  verify  the  iiput  data 
gnqdiically,  to  see  the  flow  of  the  battle  as  it  occurs  and  review  die  battle  after  the  game. 
Because  users  and  analysts  can  see  what  is  going  on,  they  have  greater  confidence  that 
systems  and  fdienomena  are  appropriately  represented. 

The  resolution  wanted  by  Janus  users  is  one  limitation  riiared  with  other  war  games.  The 
more  the  game  can  do,  the  more  users  want  it  to  do.  The  requirement  to  represent  more 
phmomenology  and  larger  numbers  of  combat  systems  is  rapidly  coming  up  against  the 
capacity  of  the  hardware  base  which  supports  Janus.  For  near-term  solution,  TRAC  is 
investigating  the  possible  use  of  relatively  inexpensive  co-processor  boards  which  plug  into 
existing  VAX  systems  and  has  investigated  distributed  processing  of  the  game  on  multiple 
computers,  possible  at  different  sites.  For  long-term  grov^,  a  Janus  Futures  program  is  being 
planned. 

D.  Theater  Analysis  Model  (TAM). 

TAM  grew  out  of  several  manual  wargaming  tools  originally  developed  to  support  conflict 
resolution  for  the  annual  Chairman  of  the  Joint  Chiefs  of  Staff  and  Commander-in-Chiefs 
(CINC’s)  War  Game.  As  the  scenario  for  this  conference  became  increasingly  complicated 
and  began  to  involve  conflict  at  the  higher  ends  of  the  spectrum  of  war  at  sea,  on  land,  and 
in  the  air,  the  need  for  conflict  resolution  grew  in  scope  and  required  increased  automation. 
The  current  version  of  TAM  evolved  out  of  this  need  to  address  conflicts  from  selective  air 
and  naval  strikes  to  global  maritime  operations  and  major  theater  warfare. 

TAM,  as  a  system,  consists  of  a  set  of  tools  that  woik  together  to  model  warfare  in  a  variety 
of  environments.  The  AirLand  Campaign  Model  (ALCM)  simulates  air  and  ground  warfare 
at  the  theater  level  anywhere  in  the  world.  While  it  focuses  on  operational  level  issues,  it  also 
provides  a  ctpability  to  "zoom"  in  on  lower  level  operations.  It  also  addresses  logistics 
consumption  and  di^bution  within  a  theater  and  nuclear,  chemical,  and  biological  warfare. 
The  Maritime  Campaign  Model  (MCM),  simulates  global  maritime  activities  (including 
shipping,  anti-sh^ing,  ASW,  ASUW,  and  port  operations).  It  interacts  with  the  ALCM 
through  the  delivery  of  supplies,  reinforcements,  and  other  goods  to  the  various  theaters.  The 
Naval  Engagement  Model  is  an  MCM  subset  which  simulates  detailed  engagements  between 
battle  groups,  individual  ships,  submarines,  and  aircraft,  while  the  Air  Engagement  Model 
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snmlates  detailed  engagements  between  aircraft,  SAMs,  sensors,  and  ground  and  naval  targets. 
All  die  conqKments  are  cmnplanaitary,  providing  a  flexible  family  of  tools  to  support  gaming 
and  n^id'tumaround  analysis. 

The  current  and  mi-going  design  development  strategies  for  TAM  have  enq[diasized  four 
approadies  of  particular  interest  to  this  workshop:  data  indqiendence,  rqiid  prototyping, 
keeping  the  man-in~the-loop,  and  die  development  of  an  appropriate  gnydiic  interface.  Data 
independence  has  been  achieved  by  the  employment  of  carefully  designed  tables  whidi  can 
be  easily  modified  or  updated  from  within  TAM.  This  approach  insures  that  everything  from 
order  of  batde  information  to  system  curabilities  can  be  adjusted  rqiidly,  bodi  in  real  time  and 
at  rates  faster  dian  real  time.  Rqiid  prototyping  permits  continuing  developmmt,  en^loyment 
and  testing  of  the  model  at  rates  diat  reduce  the  problems  of  hardware  and  software 
obsolescence  which  plague  many  of  our  models  today.  While  the  model  can  also  be  forced 
to  Mecute  screed  scenarios,  it  is  at  its  best  in  man-in-the-loop,  free-play  games  where  players 
can  interact  and  make  decisions  at  any  interval  key  to  the  scenario  being  played.  And  fin^y, 
a  gn^hics  interface  is  now  under  develoimient  wMch  wUl  employ  a  message-passing  strategy 
to  enhance  (and  sin^lify)  the  input  of  player  decisions  and  display  of  conflict  results. 

TAM,  belonging  to  J-8,  the  Joint  Staff,  has  been  employed  by  the  Chairman  of  the  Joint 
Chiefr  of  Staff,  the  NATO  (Chiefs  of  Delegation,  Siq>reme  Headquarters,  Allied  Command 
Europe,  and  by  J-8,  Joint  Staff,  to  support  Conventional  Force  Europe  (CFE)  analyses.  More 
recently,  the  Canadian  military  and  Supreme  Allied  Command,  Atlantic  (SACLANT)  have 
expressed  interest  in  employing  TAM. 

E.  Enhanced  Naval  Warfare  Gaming  System  (ENWGS). 

ENWGS  is  a  large  mainframe-based  set  of  software  to  assist  Naval  officers  in  decision¬ 
making.  The  environments  simulated  range  from  tactical  to  strategic  situations  and  present 
partic^ants  with  simulated  warfare/conflict  areas. 

Current  ENWGS  limitations  are  that  the  mainframe  hardware  suite  is  more  than  ten  years  old, 
the  operating  system  is  no  longer  in  production  and  receives  minimal  levels  of  manufacturer 
support,  the  software  is  procedurally-based  and  is  not  easily  maintained  or  modified,  and 
coiiununication  between  host  and  remote  sites  (or  inter-operabUity  between  multiple  host  sites) 
is  restricted  to  leased  lines  or  to  networks  that  suffer  from  reliability  problems. 

ENWGS  will  be  re-hosted  in  the  next  few  years  to  take  advantage  of  newer  and  faster 
hardware  platforms.  Its  software  suite  will  be  converted  to  applications  programs  that  are 
inherendy  more  current  with  engineering  and  software  development  technology.  The  operating 
system  will  be  a  broad-based,  widely  utilized  system  so  that  portability  of  models  and  systems 
will  cease  to  exist  as  major  issues.  And,  finally,  the  conununications  technology  that  will 
exist  by  the  time  of  this  conversation  will  offer  significandy  more  standardized  protocols, 
greater  bandwidth,  and  increased  reliability.  ENWGS,  at  this  point,  will  not  only  be  a  mature 
and  widely-used  wargaming  system,  but  it  will  be  better  capable  to  take  advantage  of  die 
technology  that  will  exist. 


F.  SIMNET. 


SIMNET  is  an  advanced  research  project  sponsored  by  die  Defense  Advanced  Research 
Projects  Agency  (DARPA)  in  partnersh^i  with  the  United  States  Army.  The  goal  of  the 
program  is  to  develop  the  technology  to  build  a  large-scale  network  of  interactive  ctmibat 
simulators.  This  simulated  battlefield  will  provide,  for  the  first  time,  an  oi^rtunity  for 
fully-manned  platoon-,  conqiany-,  and  battalion-level  units  to  fight  force-on-force  engagemoits 
against  an  qipropriately  scaled  and  realistic  opposing  force.  Furthermore,  it  does  so  in  the 
context  of  a  joint,  combined  arms  environment,  with  the  cmiqilete  range  of  command  and 
ctmtrol  and  combat  service  support  elements  essential  to  combined  arms  combat.  Most  of  the 
elements  that  can  affect  the  outcome  of  a  battle  are  represmted  in  diis  engagemern,  with 
victory  likely  to  go  to  that  unit  that  is  able  to  plan,  orchestrate,  and  execute  its  combined-arms 
battle  operations  better  than  its  opponent.  Whatever  the  outcome,  combat  units  will  benefit 
from  this  c^^rtunity  to  practice  collective,  combined  arms,  joint  war  fighting  skills  at  a 
fraction  of  the  cost  of  an  equivalent  exercise  in  the  field. 

While  simulators  to  date  have  been  shown  to  be  effective  for  training  specific  military  skills, 
their  high  costs  have  made  it  impossible  to  buy  enough  simulators  to  fully  train  the  force. 
Further,  because  of  the  absence  of  a  technology  to  link  them  together,  diey  have  not  been  a 
factor  in  collective,  combined  arms,  joint  training.  SIMNET  addresses  both  of  these  problems 
by  aiming  its  research  at  three  high  payoff  areas,  namely: 

•  Better  and  cheq)er  collective  training  for  combined  arms,  joint  war  fighting  skills. 

•  A  test-bed  for  doctrine  and  tactics  development  and  assessment  in  a  full  combined 

arms  joint  setting. 

•  A  "simulate  before  you  build"  development  model. 

These  payoffs  are  achievable  because  of  recent  breakthroughs  in  several  core  technologies 
that  have  been  {q)plied  to  the  SIMNET  program  including: 

•  High  speed  microprocessors. 

•  Parallel  and  distributed  multiprocessing. 

•  Local  area  and  long  haul  networking. 

•  Hybrid  depth  buffer  grsphics. 

•  Special  effects  technology. 

•  Unique  fabrication  techniques. 

These  technologies,  applied  in  the  context  of  "selective  fidelity"  and  "rapid  prototyping"  design 
jriiilosqphies,  have  enabled  SIMNET  development  to  proceed  at  an  unprec^ented  pace, 
resulting  in  the  fielding  of  the  first  production  units  at  Fort  Knox,  Kentucky,  just  three  years 
into  the  development  cycle. 
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In  additiim  to  the  basic  training  qjplications,  work  is  underway  to  apply  SIMNET  technology 
in  die  area  of  combat  develoimient  to  aid  in  the  definititm  and  acquisition  of  weapon  systems. 
Thin  is  made  possible  because  of  the  low  cost  of  the  simulators,  the  ease  with  which  they  can 
be  modified,  and  die  ability  to  network  them  to  test  the  oiqiloyment  of  a  proposed  werqion 
system  in  die  tactical  context  (i.e.,  within  die  context  of  joint  and  ctnnbined  arms  setting). 

A  SIMNET  vdiicle  simulator  contains  crew  stadons  with  controls,  ctnnputer-generated  grrqihic 
di^lays,  and  simulation  software.  The  controls  are  modelled  after  those  in  the  actual  vehicle. 
Color  graphic  displays  provide  representations  of  what  crew  members  would  see  through  actual 
vision  blocks  and  periscopes.  A  partial  list  of  the  behaviors  that  the  simulation  software 
accurately  mottels  includes  vehicle  dynamics,  ballistics,  batde  damage,  and  resource  dqiletion. 

These  simulators,  each  supported  by  their  own  set  of  microprocessors,  are  interconnected  by 
data  cmnmutiication  links  or  network.  The  networking  of  simulators  permits  regular,  intensive 
practice  of  combat  skills  by  large  teams.  Computer  networking  allows  groups  of  players  to 
be  geogrtqrhically  distribute,  sometimes  thousands  of  miles  away. 

Developmental  SIMNET  (SIMNET-D)  extends  the  SIMNET  technology  to  provide  an  enhanced 
capability  for  analysis  and  evaluation  in  the  areas  of  training  system  effectiveness  and  the 
development  of  combat  systems  and  tactics  doctrine. 

The  SIMNET-D  architecture  provides  for  the  collection  and  analysis  of  data  from  a  SIMNET 
exercise  and  the  introduction  of  semi-automated  units  as  participants  of  an  exercise.  With 
SIMNET-D,  whole  fighting  units  of  modified  we^n  systems  can  be  tested  in  teams  against 
other  baseline  weiqxrns.  Weapon  system  performance  factors  and  tactics  can  be  changed  to 
evaluate  combat  developmems  for  foture  systems. 

G.  SIMNET  Semi-Automated  Forces  (SAF). 

The  effective  use  of  SIMNET  both  as  a  trairung  medium  and  as  a  combat  developments 
laboratory  requires  large  numbers  of  units  to  be  realistically  represented.  SAF  project  goals 
are  to  represent  units  whose  behavior  is  sufficiently  realistic  that  an  observer  will  be  unaware 
that  the  vehicles  he  sees  are  not  being  marmed  by  human  crews,  and  to  provide  such  numbers 
of  SAF  vehicles  without  requiring  large  numbers  of  humans  to  crew  them. 

The  SAF  system  is  semi-automated  with  an  operator  in  supervisory  control  of  a  large  number 
of  combat  and  support  systems  simulations  on  a  single  simulation  machine.  This  is  in  contrast 
to  the  manned  SIMNET  simulators,  which  have  up  to  four  crewmen  in  complete  control  of 
a  single  vehicle  simulation  on  its  own  set  of  simulation  hardware.  The  SAF  operator  is 
expected  to  irqrut  orders  to  the  system  at  a  selected  level.  For  example,  the  system  will 
respond  to  orders  at  the  battalion  conunander  level  by  automatically  controlling  the  battalion 
assets  to  carry  out  the  order.  However,  the  operator  can,  at  will,  drop  down  the  command 
chain,  take  direct  control  of  any  company,  and  then  move  back  up  to  the  battalion  commander 
level.  The  curator  can  interrupt,  modify,  or  override  any  automated  system  behavior.  SAF 
provides  an  upwards  path  to  large  scale  combat  simulation  integrated  with  vehicle  on  vehicle 
combat  simulation.  This  latter  will  provide  an  arena  in  which  integrated  command  level,  team 
level,  and  crew  level  training  and  combat  development  may  take  place. 
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H.  Heuristic  Combat  Evaluatum  Component  of  the  AiiLand  Battle  Managonent  Program. 

Several  very  substantial  conifer  driven  waigaming  and  combat  simulation  systems  have  been 
devel(^)ed  over  die  past  ten  years  (for  exan^le,  CASTFOREM,  VIC,  FORCEM,  CORBAN, 
JESS,  JANUS),  stnne  of  which  are  used  extensively  in  military  training  exercises.  However, 
few  ate  inesaidy  used  for  planning  military  operations  in  real-time  situations.  The  What-If 
Combat  Simulator,  a  combat  simulation  designed  and  developed  as  part  of  the  DARPA/Army 
ALBM  project,  is  designed  to  provide  useful  adjunct  to  die  batdefield  cmninaiider’s  operatimis 
planning  effort.  It  does  so  by  providing  a  few  orders  of  magnitude  faster  than  teal  time 
Heuristic  Combat  Evaluator  (HCE)  which  explores  courses  of  action  and  course  of  actitm 
fragments  produced  by  a  scenario  generator  or  plan  generator. 

A  critical  component  in  the  planning  cycle  of  an  operation  is  the  G2/G3  manual  wargaming 
of  a  proposed  Course  of  Action  to  determine  feasibility,  strengths,  and  weaknesses  of  that 
proposed  course  of  action.  This  manual  wargaming,  taught  at  the  Command  and  General  Staff 
College  (CGSC),  is  expected  to  cover  many  hours  of  battle,  and  several  branches  of  the  game, 
in  minutes.  To  do  this  die  CGSC  teach  a  number  of  heuristics  (such  as  tables  of  advance 
rates,  tables  of  comparative  strength,  probabilities  of  outcome  given  con^arative  strength,  et 
cetera),  and  rely  on  the  tactical  experience  of  dw  G2/G3  to  cany  out  this  wargaming  process. 
This  process  can  thus  be  characterized  as  a  very  much  faster  than  real  time  combat  simulation 
with  what-if  branching. 

A  combat  simulation  which  is  to  provide  support  to  the  G2/G3  war  gamers  has  to  have  the 
following  attributes:  it  must  be  orders  of  magnitude  faster  than  real  time;  permit  branch 
wargaming  and  scenario  modifications  (what-if)  at  arbitrary  stages  of  die  simulation;  store  the 
entire  simulation  game  tree  for  retrieval,  re-simulation  and  examination;  and  permit  the  G2/G3 
modifications  to  the  simulation.  In  other  words,  the  simulation  generates  the  space  of  possible 
tactical  solutions  and  the  military  experts  review  that  space  for  tactical  solutions. 

Ease  of  use  and  rqiid  execution  are  the  first  two  requirements  demanded  by  the  ALBM 
project  that  HCE  addresses.  HCE  generates  an  initial  scenario  from  the  Blue  Course  of  Action 
and  the  proposed  Red  Courses  of  Action.  In  addition,  HCE  provides  powerful  scenario  editing 
facilities  to  enable  the  G2/G3  war  gamers  quickly  to  define  and  redefine  the  initial  and 
intermediate  situations,  the  course  of  action  to  be  explored,  and  the  most  likely  enemy  course 
of  action.  To  achieve  rapid  execution,  HCE  is  a  look-ahead  discrete  event  combat  simulation 
driven  by  contingent  procedural  scripts.  The  outcomes  of  military  engagements  are  rapidly 
determined  using  heuristics  developed  under  die  direction  of  wargaming  experts  at  the  CGSC, 
Ft.  Leavenworth.  The  event  driven  character  of  the  underlying  simulation  dictates  that  the 
computation  be  done  only  when  required,  thus  leading  to  rapid  execution. 

The  scope  and  conqrlexity  of  military  operations  to  be  covered  by  a  successful  war  gamer 
requires  a  significant  military  knowledge  base.  To  meet  this  requirement,  a  Contingent 
Hierarchical  Script  (CHS)  Language  and  Editor  was  developed  to  provide  specialist  support 
for  combat  simulation.  This  Combat  CHS  subsystem  has  been  developed  as  one  of  the 
significant  support  system  for  HCE.  It  c^tures  the  procedural  knowledge  required  to  simulate 
conqrlex  military  actions  in  declarative  terms.  Terminological  knowledge,  such  as  "a 
battalion-plus  has  five  conqranies,"  is  represented  using  flavors.  Procedural  knowledge,  such 
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as  "an  attack  cmsists  of  an  approach  march,  followed  by  a  pre-battle  and  a  battle  march,"  is 
rqttesented  by  CHS’s  goal/procedure  language.  CHS  has  a  grqrhical  editor  to  facilitate 
knowledge  acquisition  with  military  dcmuun  experts. 

Waigaming,  by  its  very  nature,  requires  die  exploration  of  numy  possible  event  outcomes. 
Eadi  event  outcome  has  an  associated  likelihood,  attrition,  engagement  duration,  and  a 
statement  of  winAoss.  ALBM’s  HCE  provides  an  advance  in  wargatning  tedmology 
providing  explicit  tools  to  allow  manual  and  automatic  exploration  of  mult^le  outcomes. 
For  each  military  engagement,  several  possible  outcomes  ate  determined,  and  unless  told 
otherwise  by  die  Q2/G3  war  gamers,  the  most  likely  outcome  is  the  cme  explored. 
Alternatively,  the  system  can  be  set  up  to  automatically  explore  multiple  outcmnes  above  some 
02/03  war  gamer  set  likelihood  threshold  in  a  depth  first  fashion  with  most  likely  outcome 
explored  first  Most  likely  depth  first  is  chosen  so  that  the  system  reaches  a  final  outcome 
as  soon  as  possible.  At  any  time,  it  is  possible  to  revisit  any  engagement  and  explore  the 
odier  outcomes.  Indeed,  should  the  02/03  war  gamers  disagree  with  the  conq>uter  d^eimined 
outcomes,  there  is  limited  cq>ability  for  them  to  redefine  the  outcome  and  continue  war  game 
exploration.  This  ability  to  redeye  outcomes  and  adjust  the  scenario  are  features  under 
develtqxnent  to  provide  the  operations  planner  with  a  truly  powerful  wargaming  cipability. 

The  core  of  the  HCE  technology  is  a  three  corrponent  audit  trail,  each  one  of  which  is 
coordinated  with  the  others.  First,  a  graphical  representation  of  the  game  tree  of  war  game 
combat  events  is  provided  and  saved  as  the  war  game  proceeds,  the  branches  in  the  game  tree 
corre^nding  to  war  game  branches.  Second,  for  each  war  game  combat  event  a  tactical 
overlay  is  presented  and  saved.  Finally,  a  message  log  of  the  war  game  actions,  at  G2/G3 
war  gamer  controlled  levels  of  detail,  is  dso  provided  and  saved.  Selecting  events  or  branches 
tm  the  game  tree  allows  the  G2/G3  war  gamer  to  scroll  backwards  and  forwards  through  the 
war  game  history,  with  the  tactical  overlay  and  the  message  log  maintained  in  synchronization. 
At  any  point,  the  G2/G3  war  gamer  may  specify  alternate  branches  to  explore,  or  reset  the 
system  parameters. 

The  HCE  is  built  in  a  modular  fashion  that  places  no  requirements  on  the  details  of  the 
tactics,  doctrine,  or  wargaming  algorithms.  These  may  be  modified  or  replaced  at  will  by 
die  military  community.  The  HCE  is  a  technology-  that  allows  the  military  tactician  to  explore 
the  results  of  courses  of  action  within  a  tactic^  world  defined  by  himself.  The  HCE  is 
designed  and  built  to  be  either  integrated  widi  a  planning  system,  or  to  be  used  stand-alone 
as  a  independent  wargaming  tool,  tactics  trainer,  or  planning  tool.  In  its  stand-alone  form  it 
is  especially  useful  as  a  tool  to  explore  synchronization  and  coordination  issues. 

V.  CONTINUING  LIMITATIONS/PROBLEMS  IN  WARGAMING 

Advances  in  hardware  and  software  technology  will  he^  in  solving  many  of  the  current 
problems  and  limitations  in  war  games  and  simulation.  However,  not  all  problems  can  be 
solved  by  technology  and  other  approaches  to  solving  the  problems  identified  below  will  have 
to  be  found. 
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A.  Bmeaucratic  Lunitadons. 


The  iMtoie  of  any  wganizadon  is  to  create  a  stractured  process  to  control  die  operation  of  its 
entities.  Often,  tfiis  structure  (standard  operating  procedures  or  whatever)  will  create  obstacles 
to  timely  completion  of  projects.  Within  the  waigaming  community,  these  organizational, 
political  or  q;>erational  barriers  will  force  war  gamers  to  refocus  priorities  in  order  to  achieve 
progress. 

Sharing  of  models  and  data  bases  is  an  example  of  how  some  organizations  in^se  ccmstraints 
which  affect  the  wargaming  omimunity.  Agencies  are  sometimes  reluctant  to  release  these 
resources  to  other  agencies  or  allies.  Ihis  occurs  for  a  variety  of  reasons.  However,  the  end 
result  is  the  same;  progress  is  delayed  on  the  requestor’s  project. 

A  seccmd  exanqile  of  a  bureaucratic  burden  that  is  outside  the  control  of  modelers  is  the  need 
to  "work"  the  procurement  system  in  order  to  purchase  new  equipment  or  professional  services. 
The  productivity  of  models  is  reduced  twice  by  this  bureaucratic  need.  The  model 
(tevelo|»nent  is  delayed  one  to  two  years  awaiting  procurement  and  the  modeler  experts  must 
work  (»i  the  procurement  effort  instead  of  models. 

The  final  exanq>le  of  how  bureaucracy  can  affect  the  wargaming  community  is  the 
inq>lementation  of  die  new  "revolving  door"  limitations  imposed  by  Congress.  These  will  deny 
retiring  military  modelers  and  war  gamers,  the  domain  experts,  the  opportunity  to  contribute 
to  the  community  from  which  they  gained  their  experience. 

B.  Organizational/Management  Limitations. 

The  proliferation  of  gaming  systems  is  expected  to  increase  as  the  availability  and  capability 
of  hardware  and  software  continue  to  grow.  Different  kinds  of  systems  will  be  developed 
under  various  sponsors,  creating  a  multitude  of  gaming  proponents  with  favorite  hardware, 
software,  and  conflicting  agendas.  These  gaming  systems  will  use  different  approaches, 
requiring  duplication  of  effort  and  additional  expenditure  of  scarce  resources. 

As  technology  continues  its  rqiid  change,  increasing  technical  management  of  gaming  systems 
will  be  required.  The  large  installed  equipment  base  will  serve  to  discourage  managers  from 
nuiking  the  decision  to  replace  obsolete  systems,  even  when  this  decision  would  be  cost 
effective  in  die  longer  term. 

Getting  the  right  players  to  participate  at  the  most  appropriate  stage  of  the  gaming  process  will 
continue  to  be  difficult.  As  the  number  of  games,  players,  and  proponents  increases,  the 
potential  misuse  of  particular  gaming  processes  and  results  will  also  increase. 

C.  Social/Political/Human  Factors  Limitations. 

At  the  technical  level,  hardware  and  software  advances  will  greatly  enhance  our  ability  to 
consider  an  ever-widening  array  of  variables.  This  greater  crqiacity  will  not,  however,  solve 
the  problems  we  currently  face  in  credibly  modelling  social  dynamics,  the  actions  and 
decisions  of  political  groups,  or  non-quantifiable  (or  objectively  measurable)  human  factors. 
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Excqx  in  low  lesolutkm  tenns,  we  will  remain  unable  to  accurately  or  reliably  model  how 
individuals  process  data  and  arrive  at  decisions.  This  limitaticm  will  continue  to  hamper  the 
develpfmmit  of  games  which  can  usefully  model  the  behavior  of  political  entities,  such  as 
states  and  naticHial  level  decisi<Hi-making  groups.  The  magic  of  aggregation,  however,  will  aid 
us  in  inqmving  our  ability  to  model  group  or  team  decision  process^.  Cognitive  loading 
models  (vdiich  deal  widi  how  teams,  and  to  some  degree  individuals,  sort  and  react  to 
information,  indudmg  sensory  iiqmt)  will  not  be  available  for  use  by  war  gamers  in  dw  near 
term,  but  drould  begin  to  arrive  in  rive  to  ten  years. 

D.  Artificialities  and  Risks. 

Unfortunately,  we  will  stiU  be  unable  to  accurately  model,  widiout  human  players  in  die  loop, 
at  the  very  finest  levels  of  detail.  Our  increasing  capability  to  handle  larger  numbers  of 
variables  and  increasing  masses  of  data  may  lull  many  users  into  believing  we  can  model 
die  finest  details.  This  will  aggravate  the  already  existing  demand  for  greater  detail  and  larger 
masses  of  data  output  from  our  models.  The  great  danger  is  that  decision  makers,  whose 
"combat"  experience  will  be  based  more  and  more  on  war  games  as  those  with  actual 
experience  retire,  will  internalize  "lessons"  based  on  artificialities  in  the  models  we  use. 
Widiout  actual  operational  experience  to  balance  against  the  lessons  of  games,  learning  may 
tend  to  be  driven  more  by  modelling  assumptions  than  by  real  world  experiences.  Gaming 
artificialities  may  thus  irt^se  greater  risks  in  the  future  and  will  make  it  more  imperative 
than  ever  that  we  insure  we  have  the  right  players  involved  at  the  right  point  in  games  and 
that  we  do  a  better  job  of  educating  users  in  the  limitations  of  games. 

Despite  all  our  advances,  we  will  remain  unable  to  replicate  reality  except  in  the  most  limited 
ways.  We  will  letrudn  urrable  to  produce  models  which  are  genuinely  predictive  (with  the 
exception  of  models  which  predict  quantifiable  physical  phenomenon  such  as  the  failure  rates 
of  automotive  or  weqrons  systems)  and  will  continue  to  face  die  problem  of  convincing  the 
user  to  accept  results  which  are  credible  and  reasonable  rather  than  "accurate"  or  "predictive." 
Debates  will  continue  to  rage  over  what  contribution  ganring  can  realistically  be  expected  to 
make  to  the  atudysis  of  difficult  problems,  or  how  gaming  can  contribute  to  the  synthesis  of 
gaming  insights,  perceptions  of  reality,  and  experience.  None  of  these  limitations,  however, 
wiU  dampen  the  demand  for  gaming  to  address  more  and  more  issues,  nor  will  they 
significantly  retard  the  tq>plication  of  imagination  to  achieving  capabilities  we  cannot  now 
envision. 

E.  Continuing  Technical  Limitations  and  the  Costs  of  Rising  Expectations. 

Continuing  technical  limitations  in  the  hardware/software  (HW/SW)  environment  can  be 
divided  into  two  categories.  The  first  category  is  data  and  algorithm  oriented.  The  latter 
category  centers  on  the  human  ability  to  accept  and  employ  wargaming  in  a  correct  and 
reasoiu^le  manner. 

Hardware  and  software  advances  will  imdoubtedly  increase  the  volume  and  complexity  of  data 
which  can  be  included  in  any  one  game.  Rather  than  solving  storage  and  collection  problems, 
it  is  probable  that  increased  external  storage  and  the  ability  to  collect  data  from  automated 
systems  will  compound  current  data  integrity  and  maintenance  problems.  For  exan^le. 
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(AMolete  weapon  system  peifoimance  characteristics  will  be  difficult  to  identify.  Outdated 
force  laydown  postures  will  continually  require  updiaing.  Geo-political  alliances  and 
infrastructure  data  elements  also  require  continuous  nuuntenance.  New  data  elements  must  be 
to  reflect  the  reality  of  new  weqxms  technology  and  threats.  The  cq>ability  to  cqiture 
vtdumes  of  data  will  require  yet  to  be  designed  aggregation  and  synthesis  techniques. 

Game  fidelity  will  cmitinue  to  present  challenges  to  the  war  game  community.  Increased 
data  detail  truly  prompt  mote  detailed  game  designs.  The  arudyst  must  balance  the  availability 
of  data  with  the  need  for  elegance  and  sinqtlicity. 

Object  oriented  programming  (OOP)  techniques  have  been  proposed  as  one  way  to  cqte  with 
the  inherent  problems  of  data  base  design.  The  qtplication  of  OOP  to  existing  data  will 
require  te-ongineering  and  revalidation  of  current  data  bases.  (This  should  be  easily 
acconqilidied  by  automated  systems.)  Additionally,  die  ease  of  creating  new  object-oriented 
games  will  require  careful  identification  and  selection  of  data  bases  and  algorithms.  We  will 
need  to  help  users  avoid  comparing  algorithms  which  seem  the  same  but  yield  differing 
outcomes. 

These  issues  cotiqxiund  the  fdiilosophical  challenges  of  gaming.  Users  searching  for  definitive 
answers  will  denuuid  ever  more  detailed  data  and  will  continue  to  misinterpret  game  outcomes 
as  assessments.  It  will  be  the  job  of  the  analyst  to  present  game  outcomes  as  synthesis  or 
reasonable  expectations  rather  than  "crystal  ball"  analyses  of  the  future. 

User  requirements  can  also  be  expected  to  surpass  the  most  sophisticated  technology. 
Technology  seduced  "Star  Trek"  users  will  expect  games  which  look  and  feel  like  commercial 
games  and  will  bring  diese  expeaiuions  to  the  game  room.  Technology  push  must  be 
balanced  with  implication  pull. 

The  final  technical  limitation  may  be  the  ability  of  the  user  to  remain  computer  literate  as  the 
technology  increases  in  complexity  and  the  user  becomes  more  remote  from  the  basics  of 
source  code  and  well  understood  data  stracture.  Users  may  well  demand  more  capability 
and  modifications  without  an  adequate  ippreciation  of- technic^  and  cost  ramifications.  Proper 
expectations  must  be  set  by  modelers  for  the  users. 

VI.  INSIGHTS,  PERSPECTIVES,  AND  CONCLUSIONS 

A.  Elements  of  a  War  Game. 

Developments  in  hardware  and  software  technology  can  help  improve  wargaming  as  a  whole 
only  if  those  developments  can  help  the  human  process  that  are  integral  to  gaming.  In 
particular,  such  developments  need  to  concentrate  on; 

•  facilitating  the  process  of  game  design  and  set, 

•  enhancing  the  decision  making  processes  of  the  players,  and 

•  assisting  the  aiudysis  and  interpretation  of  those  decisions. 


The  decisiofi  making  process  is  central  to  wargaming.  That  process  includes  integrating  aid 
inteipreting  die  data  available,  identifying  options,  and  understanding  the  effects  of  the 
deciskms  that  are  made. 

First,  a  war  game  must  have  a  clearly  defined  and  staed  set  of  objectives.  In  qiecifying 
diose  objectives,  the  game’s  ^nsors,  designers,  and  analysts  must  identify  how  and  in  uha 
ways  die  game  can  provide  the  information  needed  to  achi^e  those  objectives.  The  objectives 
sht^d  be  as  specific  as  possible  to  allow  the  design  of  the  game  and  its  analysts  to  focus 
<m  those  elements  of  reality  and  game  play  that  are  critical  to  the  collection  of  die  necessary 
information. 

The  scenario  sets  the  stage  for  the  game,  placing  the  players  in  the  situation  within  which  they 
are  constrained  to  make  decisions.  The  data  base  provides  the  players  the  information  they 
may  use  to  help  them  make  their  decisions.  Because  of  its  in^rtance  to  die  entire  process 
of  the  game,  the  data  base  must  present  clearly  and  concisely  the  information  the  players 
would  reasonably  have  available  to  them  in  an  actual  situation,  and  do  so  in  a  maimer  tha 
is  readily  accessible  for  their  use  during  play.  The  game’s  mathematical  models  of  reality 
translate  data  and  decisions  into  game  events.  The  models  must  be  flexible  enough  to  deal 
with  unexpected  player  decisions,  modular  enough  to  allow  the  data  base  to  change  without 
requiring  major  changes  to  the  models  themselves,  and  accurate  enough  to  reflect  realistically 
diose  factors  most  inqiortant  to  the  decision  making  levels  represented  by  the  players.  In 
addition  to  the  models,  a  game  must  also  have  a  set  of  rules  and  procedures  to  define  wha 
the  players  can  and  cannot  do  and  why.  Hie  procedures  help  to  sequence  game  events, 
allowing  for  accurae  chains  of  cause  and  effect.  Specific  procedures  are  also  needed  to 
ensure  tha  the  players  receive  the  appropriae  quantity  and  quality  of  information  during  play, 
and  to  introduce  error  and  delay  to  simulae  die  "fog  of  war." 

Moa  importantly,  a  wa  game  must  have  human  players,  whose  decisions  affect  and  are 
affected  by  the  flow  of  the  game’s  events.  A  war  game  is  most  effective  when  players  are 
caa  in  operational  roles  and  are  given  the  infoimaion  and  responsibility  required  to  make 
decisions  rqrpropriae  to  their  roles  and  at  the  qipropriate  times  during  play.  Finally,  the 
analysis  and  interpretation  of  player  decisions  in  light  of  game  informaion  and  game  events 
is  tlw  ultimae  link  between  the  play  of  the  game  and  achieving  its  objectives. 

The  unique  character  and  utility  of  a  war  game  lies  in  the  central  role  tha  the  human  players 
and  their  decisiims  have  upon  achieving  those  objectives.  The  entire  game  design  must  be 
drivoi  by  the  ultimae  need  to  insert  the  players  and  allow  them  to  suspiend  their  disbelief 
willingly.  The  game  must  be  tailored  to  rdlow  the  players  to  use  it  easily  and  naturally,  and 
to  hel^  the  analysts  track  the  flow  of  decisions,  rationales,  and  events.  The  most  important 
potential  applications  of  current  and  future  hadware  and  software  technology  to  the  wargaming 
process  thus  fall  into  the  three  broad  classes  described  ealier; 

•  Aiding  the  process  of  game  design,  development,  and  prepaation. 

•  Enhancing  the  operational  reality  of  the  players’  decision-making  experience. 

•  Assisting  the  analysis  and  intetpretaion  of  the  decision-making  process. 
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Much  of  die  technology  needed  to  imfirove  the  practice  of  wargaming  significandy  already 
exists  todi^.  hi  some  cases,  however,  ^  available  technology  has  not  been  distributed  widely 
to  the  potential  users  or  it  is  not  easily  used  by  those  unfamiliar  with  the  tedmical  details  of 
its  development  and  implementation.  Further  exfdoration  of  seductive  new  technologies  that 
do  not  qieed  up  the  preparation  of  a  game,  oihance  the  quality  of  die  player’s  deciskm,  or 
ease  die  analysis  and  inteipretatitMi  of  those  decisions  is  so  much  wasted  effort. 

B.  Apfdkations  of  Hardware  and  Software  Technology  to  Wargaming. 

1.  Application  to  Game  Design.  Wargaming  of  one  type  or  another  has  been 
practiced  for  centuries  and  in  its  modem  form  for  at  least  one  hundred  years.  Unfortunately, 
the  designers  of  current  war  games  for  the  Department  of  Defense  too  often  embark  upon  their 
task  with  Ihde  or  no  qipreciation  for  the  work  that  has  gone  on  befcne  ("reinventing  the 
wheel"  is  a  perennial  prdilem  in  all  forms  of  defense  analysis,  but  seems  particularly  pervasive 
in  wargaming).  The  breaddi  and  depdi  of  historical  experience,  and  of  tte  experiences  of  the 
best  of  current  game  designers,  can  be  of  enormous  benefit  to  new  projects.  These 
experiences  could  be  made  more  readily  available  in  at  least  two  promising  ways. 

First,  existing  sources  and  expertise  could  be  t^^d  to  create  an  expert  system  of  knowledge 
bases  that  could  provide  the  game  Jesigner  with  easy  access  to  proven  solutions  to  common 
problems  and  advice  about  those  approaches  that  have  proven  to  be  dead  ends.  Successful 
design  practice  could  also  be  codified  in  a  set  of  automated  game  design  tools  to  help 
stracture  the  skeleton  of  a  system  and  even  to  fletii  out  its  more  common  ctunponents  (such 
as  movement  and  sensor  routines). 

To  build  on  the  basic  system  and  tailor  it  to  achieve  specific  objectives,  a  set  of  tools  fo' 
easing  the  hunuoi-machine  interface  could  be  develop^  to  aUow  the  designer  easy  and 
intuitive  access  to  the  algorithms  of  the  game.  Improved  algorithms,  processing  speed,  and 
gnq>hical  tools  will  also  he^)  the  designer  build  a  system  that  eases  the  artificial  burdens 
inq>osed  on  the  players  by  inefficient  or  unrealistic  gaming  systems.  Similarly,  the 
development  of  improved  conununications  systems,  software,  and  protocols  wiU  make  it 
possible  for  the  game  designer  to  integrate  multiple  existing  game  systems  into  a  larger 
stracture  to  achieve  more  broadly  stated  goals. 

Firudly,  new  and  existing  hardware,  software,  and  management  techniques  need  to  be  brought 
to  bear  on  the  problem  of  data  acquisition  and  management.  The  standardization  of  human, 
systons,  weapons,  and  platform  performance  data,  or  at  least  of  the  formats  in  which  such 
data  are  stored  and  manipulated,  will  go  a  long  way  toward  making  the  designer’s  task  easier 
and  more  productive. 

2.  Applications  to  Decision  Support.  Because  the  players  of  a  war  game  and 
their  Vision  making  processes  are  the  focus  of  the  game’s  research  and  the  source  of  its 
value,  hardware  and  software  developments  that  improve  the  players’  ability  to  play  the  game 
effectively  and  realistically  are  a  potentially  critical  contribution  to  the  future  of  wargaming. 
Technology  holds  the  promise  of  making  such  contributions  to  three  principal  components  of 
the  decision  making  process. 
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The  fint  conqxment  is  the  most  basic;  it  lies  in  identifying  the  inqwitant  decision  points  for 
die  players  in  ways  and  at  times  that  are  consistent  with  what  would  occur  in  an  actual 
situatkm.  One  example  is  diat  of  a  prolonged  air  campaign.  If  a  player’s  attack  aircraft  were 
suffering  heavy  casualties,  the  player  would  reasonably  expect  to  be  given  the  opportunity  to 
receive  reports  <mi  the  situation  and  to  change  tactics  ^fore  the  losses  had  crippled  his  force. 

Automated  tools  that  would  allow  the  game  system  or  control  team  to  supplement  the 
identification  of  q>ecific  decision  points  for  the  players  with  an  ability  to  provide  the  players 
with  the  appropriate  information  would  not  only  ease  the  burden  on  the  players  and  control, 
but  would  provide  a  more  realistic  decision  making  environment.  It  should  be  a  relatively 
straightforward  task  to  automate  the  collection,  filtering,  and  presentation  of  the  most  impoitant 
operational  infotmatitm  produced  by  the  game’s  models  and  procedures.  Such  tools  could 
perluq>s  be  made  adiptive  or  self-teaching,  modifying  their  presentation  to  conform  to  the  ways 
the  players  must  fiequently  employ  them. 

To  complete  the  picture,  the  players  should  be  provided  widi  qpropriate  tools  to  help  them 
analyze  the  available  data  and  assess  the  likely  outcomes  of  their  decisions.  Designing  such 
player-support  analysis  tools  should  take  into  careful  consideration  the  real-life  analytical 
resources  available  to  the  commander  in  an  actual  situation,  and  should,  of  course,  be  based 
on  the  data,  presumably  not  completely  accurate,  that  is  available  to  the  player  and  commander 
in  such  situations. 

3.  Applications  to  War  Game  Analysis.  In  addition  to  analysis  tools  for  assisting 
the  players  in  the  war  game,  automated  tools  to  support  the  analysis  of  the  game  play  as  a 
whole  are  potentially  very  valuable  additions  to  the  wargaming  process.  They  are  also 
potentially  very  difficult  to  design  well;  each  game,  each  decision  maker,  and  each  decision 
can  have  many  unique  elements  that  make  automating  dieir  analysis  a  challenge.  There  are, 
however,  certain  key  points  that  are  common  to  all  or  most  games  and  situations  of  interest. 

The  facility  to  identify  decision  points  for  the  players  (as  discussed  earlier)  provides  a  ready 
made  audit  trail  to  track  those  same  points  for  an^ytical  purposes.  In  addition,  the  ability  to 
record  the  use  made  by  the  players  of  the  various  data-accessing  and  analytical  tools  also 
described  in  the  preceding  section  can  provide  insights  about  the  course  of  the  decision  making 
process  and  the  factors  Ae  players  considered  impoitant  in  it. 

Additional  tools  specific  to  helping  game  analysts  collect  data  and  interpret  decisions  and 
events  must  be  based  on  a  more  complete  understanding  of  the  key  elements  of  the 
game-analysis  process.  A  good  starting  point  for  the  construction  of  such  tools  would  be  the 
development  of  an  expert-system  knowl^ge  base  of  the  same  general  form  as  that  described 
as  an  aid  to  game  design.  Such  a  system  might  cue  analysts  to  be  on  the  watch  for  certain 
types  of  events  and  decisions  that  are  typically  of  great  importance  in  the  analysis  of  specific 
types  of  games.  For  example,  in  games  deding  with  advanced  technological  concepts,  the 
analysts  could  be  advised  about  ways  to  explore  the  players’  attitudes  about  whether  a  new 
system  provides  an  entirely  new  c^ability  or  merely  improves  an  existing  one. 

Such  a  system,  particularly  if  defined  in  a  well-structured  format,  would  also  facilitate  the 
ability  to  cotiqrare  and  contrast  the  play  of  different  war  games.  By  allowing  analysts  to 


organize  tibeir  oqdorations  and  resulting  insights  in  consistmt  patterns,  autonuUed  analysis  tools 
mi^  nuke  the  derivation  of  broader  inq>lications  from  the  play  of  diverse  gam^  a  more 
ligotoas  and  less  ctmipletely  subjective  process.  It  is  inq;K>ftant  to  remember,  however,  diat 
die  central  role  of  human  beings  in  the  entire  gaming  process  makes  it  not  only  unlikely  but 
also  undesiraUe  diat  the  tools  substitute  for  the  talents  and  experience  of  observant  and 
insightful  analysts. 

C.  Insights  and  Recommendations. 

As  a  result  of  the  discussions  and  exchange  of  ideas  from  a  multitude  of  viewpoints,  the 
hardware/software  woildng  group  came  to  qipreciate  the  enormous  diversity  in  the 
requirements  associated  with  the  many  different  types  of  war  games.  Although  many 
requirements,  such  as  those  mentioned  earlier,  are  common  to  most  games,  othos  are  too 
specific  to  allow  easy  generalization.  Nevertheless,  some  broad  insights  did  come  from  the 
group’s  discussions. 

Perhaps  the  most  dramatic  consensus  was  reached  on  the  role  of  artificial  intelligence  systems 
in  wargaming.  Such  systems  are  not  perceived  as  a  potential  replacement  for  human  decision 
makers  in  the  gaming  process.  Instead,  AI  cjpabOities  are  extraordinarily  promising  tools  for 
supporting  the  entire  range  of  human  involvement  in  gaming,  from  the  design  and  preparation 
of  a  game,  through  support  to  the  players  (possibly  in  the  foim  of  a  computerized  staff),  to 
assistance  in  the  analysis  of  the  game. 

It  seems  q^Murent  that  many  of  the  problems  plaguing  wargaming,  and  discussed  in  some  detail 
eariier,  are  not  based  on  technological  shortcomings,  but  ratiier  are  philosophical  and 
epistemological  in  tbeir  nature.  Of  those  that  may  be  addressed  by  the  development  of 
improved  technologies,  or  merely  the  application  of  existing  technologies  where  they  have  as 
yet  remained  untipped,  few  seemed  amenable  to  solution  by  the  tpplication  of  bureaucratically 
inposed  standards. 

The  technical  and  operational  standards  that  would  be  of  most  help  to  wargaming  are  subject 
to  the  continuing  pressures  of  the  maiketplace  and  the  necessary  ingenuity  to  the  designers  and 
engineers  working  in  the  field.  The  combination  of  user  demand  and  developer  innovation 
can  be  expected  to  drive  an  increasing  pplication  of  standards  for  systems,  interfaces,  and 
other  important  elements  of  tite  wargaming  systems  of  the  future,  much  as  the  recent 
burgeoning  development  of  personal  conputing  has  purred  concurrent  improvements  in  the 
definitions  of  industry  standuds.  Peihps  the  most  important  problems  facing  the  future  of 
hardware  and  software  developments  in  wargaming  revolve  around  avoiding  the  straightjacket 
of  bureaucratic  standards  and,  at  the  same  time,  resisting  the  seduction  of  technologies  that  do 
not  significantly  improve  tire  ability  of  wargaming  to  carry  out  its  uniquely  valuable  functions 
of  exploring  the  human  dimensions  of  warfare. 

To  tiiis  end,  the  group  makes  the  following  princpal  recommendations: 

•  The  wargaming  community  must  strive  to  make  better  use  of  existing  technical 

cpabilities,  with  the  emphasis  on  taking  advantage  of  those  capabilities  to  place  the 


game  {dayeis  into  fbc  most  accurate  possible  representation  of  the  qreratunial 
environment. 


•  Appropriate  DoD  agencies  should  coordinate  the  creation  of  a  clearinghouse  for 
existing  madiematical  models  of  potential  value  to  wargaming,  making  such  models 
availaUe  for  review,  comment,  and  use  by  the  entire  community. 

•  A  similar  effort  should  be  undertaken  to  standardize  the  major  data  bases  needed  to 
run  war  games,  including  those  describing  the  cq>abilities  and  tactics  of  potmtial 
adversaries,  including,  but  not  restricted  to,  the  Soviet  Union. 

•  MORS  should  conduct  targeted  workshops  to  explore  the  problems  and  potential 
associated  with  the  preparation  of  scenarios  and  data  bases,  and  with  the  near-term 
develqxnent  of  ui^ovc^  user  interfaces  for  gaming  systems. 

In  ad:  *  'on,  a  research  and  development  program  to  attack  sonre  of  the  fundamental  difficulties 
of  wargaming  and  game  system  design  could  yield  enormous  dividends  by  establishing  a  more 
rigorous  foundation  for  wargaming  and  creating  some  of  the  basic  tools  needed  to  in^rove  the 
process.  Specifically,  die  community  should  explore  ways  of  funding  the  following  researdi 
efforts: 


•  Develop  an  automated  war  game  design  aid  based  on  existing  expertise,  historical 
research,  and  careful  assessment  of  past  and  current  practice  and  theory. 

•  Building  on  the  information,  insights,  and  expertise  developed  in  that  effort,  as  well 
as  existing  and  new  research,  develop  a  theoretical  foundation  for  the  computational 
aspects  of  wargaming. 

•  Based  on  such  a  theoretical  foundation,  develop  a  common  wargaming  language  that 
will  facilitate  the  integration  and  interfacing  of  a  large  fraction  of  existing  and  future  war 
games  without  major  rewriting  of  current  software. 

•  As  a  proof  of  concept,  demonstrate  the  feasibility  of  developing  a  wargaming  tool 
kit  to  assist  designers,  players,  and  analysts,  building  as  much  as  possible  on  tiiose 
systems,  languages,  and  techruques  alrea^  in  existence. 
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APPENDIX  F 

SUMMARY  OF  SYNTHESIS  PANEL 


I.  INTOODUCnON 

As  a  capstone  to  die  deliberations  at  the  Future  Wargaming  Developments  Workshop,  a 
synthesis  panel  was  convened.  The  panelists  included  Dr.  Stuart  Starr  (MITRE),  Dr.  Patricia 
Sanders  (OSD),  Mr.  R.  S.  Vaughn  (OCNO),  Mr.  O.  E.  "Bud"  Hay  (NWC),  CAPT  John  Heidt 
(Naval  Wargaming  C^ter),  Mrs.  Betty  Gay  (NWC),  Dr.  Allan  Schell  (AFSC),  and  ADM 
Harry  Train  (USN,  ret.)  (SAIC).  The  panel  members  were  asked  to  address  the  workshop 
atteixlees  rm  three  subjects:  their  reactions  to  the  reports  from  the  working  groups; 
reccHiunendatirms  on  war  game  developments  that  would  prove  of  value  and  interest  to  officials 
at  the  level  of  the  Under  Secretary  of  Defense  for  Acquisition  [USD(A)];  and  personal  insights 
on  future  wargaming  developments.  The  remarks  of  the  individual  panelists  are  summarized 
below. 


n.  OBSERVATIONS  OF  THE  PANEUSTS 
A.  Dr.  Stuart  Starr. 

Dr.  Starr  began  his  remarks  by  referring  to  the  observation  made  by  the  Systems  Acquisition 
Working  Group  that,  due  to  recent  geopolitical  changes,  a  conceptual  vacuum  existed  in  the 
acquisition  process.  To  redress  that  void.  Dr.  Starr  recommended  that  a  hierarchical  series  of 
conceptual  war  games  should  be  conducted  (using  available  assets)  to  help  formulate  a 
framework^aradigm  within  which  future  acquisition,  OT&Es,  and  training  activities  could  be 
formulated  and  planned.  As  a  strawman,  tfiree  tiers  of  war  game  were  suggested:  a 
geopolitical-national  security  game,  at  the  National  Security  Council  staff  level;  a  defense 
strategy  game,  at  the  Under  Secretary  of  Defense  for  Policy  level;  and  military  service  strategy 
games,  at  the  Service  Senior  Acquisition  Executive  (SAE)  level.  It  was  recommended  that 
these  efforts  be  coordinated  so  that  the  resulting  framework  would  be  consistent,  with 
progressively  increased  granularity. 

In  reqxnise  to  the  request  for  strawman  recommendations  for  USD(A),  Dr.  Starr  proposed  the 
following.  In  the  area  of  policy.  Dr.  Starr  reconunended  that  the  DoD  5000  series  documents 
be  revised  to  require  a  war  game  usage  plan  for  major  system  acquisitions.  In  addition,  he 
recommended  that  war  games  above  a  specifred  threshold  in  life  cycle  costs  (e.g.,  $20M  (FY90 
dollars))  be  required  to  adopt  appropriate,  sound  systems  engineering  princ4}les.  This  would 
include  iqrpropriate  levels  of  documentation,  contfrguration  management  controls,  plans  to 
evolve  the  war  game  and  interface  it  with  related  war  games,  and  a  plan  for  inserting  evolving 
technology  into  the  war  game. 

In  die  area  of  planning.  Dr.  Starr  recommended  that  the  USD(A)  cause  to  have  developed  a 
roi^map  to  guide  the  evolution  of  war  games.  This  roadmap  would  serve  to  minimize 
redundant  efforts  and  to  promote  community  sharing  and  efficiency.  It  should  encompass  war 
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gamM  that  support  mult^le  objectives  (e.g.,  acquisititm,  test  and  evaluation,  educatum,  and 
training),  facilitate  the  internetting  of  war  ganKs,  and  support  the  injection  of  technology  into 
war  games.  It  was  recwnmended  that  the  Joint  Requirements  Oversight  Council,  chaiied  by 
die  Vice  Chairman,  JCS,  participate  in  the  develqnnent  of  this  roadnuq). 

Finally,  Dr.  Starr  recommended  that  the  position  of  Director,  War  Game  Inqilementation  and 
Systems  Evaluadcm  (WISE),  be  established  in  the  office  of  the  USD(A).  ("It  was  subsequently 
noted  diat  the  acronym  WISE  is  curroitly  used  by  Women  In  Science  and  Engineering.")  The 
broad  intent  of  such  an  actitm  would  be  to  establish  an  institutional  focal  point  to  implonent 
and  oversee  broad  initiatives  for  the  diverse  wargaming  community.  Such  a  directorate  would 
perform  the  following  functions: 

Policy:  The  directorate  would  formulate  policy  for  wargaming  development  (to  include 
guiddines  for  accreditation)  and  use. 

Planning:  The  directorate  would  be  responsible  for  the  preparation  and  maintenance  of 
the  wargaming  roadmap  cited  above. 

Programming:  The  directorate  would  provide  oversight  for  die  allocation  of  resources 
for  wargaming  in  the  Program  Objective  Memorandums  (POMs). 

RDT&E:  The  directorate  would  be  given  control  of  modest  resources  to  support  and 
stimulate:  the  development  of  standards  to  interface  war  games;  the  establishment  of  a 
clearinghouse  for  models  and  databases:  R&D  for  key  tools  (e.g.,  the  analyst’s  workbench 
proposed  in  SIMTECH  97);  the  identification  and  refinement  of  requirements  for  war  games; 
and  the  cross-fertilization  of  wargaming  activities  across  the  areas  of  acquisition,  T&E, 
training,  and  education. 

B.  Dr.  Patricia  Sanders. 

Dr.  Sanders  began  her  remarks  by  observing  that  the  acquisition  process  is  broken  (or  "at  least 
bent");  "it  takes  too  long  and  is  too  expensive."  She  stated  that  wargaming  has  the  potential 
to  alleviate  some  of  the  problems  in  the  acquisition  process,  although  she  cautioned  that  it 
should  be  viewed  as  only  one  of  several  qiplicable  tools. 

Dr.  Sanders  provided  several  guidelines  on  the  use  and  value  of  war  games.  First,  she  urged 
that  war  games  be  q^lied  early  in  the  acquisition  process  to  help  illuminate  choices.  Second, 
she  recommended  that  wargaming  enqthasize  one  facet  of  the  problem  where  most  other  tools 
are  deficient:  including  die  role  of  die  decision-maker.  In  addition,  she  observed  that  one  of 
the  major  strengths  of  wargaming  is  its  ability  to  treat  the  broad  context  within  which  systems 
are  employed.  Finally,  she  noted  that  one  of  the  most  promising  applications  of  wargaming 
was  to  help  select  tqipropriate  technologies  to  match  up  with  perceived  requirements. 

Dr.  Sandors  summarized  her  remarks  by  observing  that  if  war  games  are  used  judiciously,  they 
hold  the  promise  of  reducing  acquisition  costs  and  minimizing  associated  risks. 
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C.  Mr.  Ray  Vaughn. 


Mr.  Vaughn  initiated  his  lenuuks  by  observing  that  there  was  a  desperate  need  for  "better" 
decisions.  He  expressed  hqw  diat  war  games  would  prove  to  be  key  tools  that  would  i»omote 
those  better  decisitms.  However,  he  noted  that  high  level  decision  makers  need  to  be 
convinced  of  the  value  of  war  games  so  that  they  are  willing  to  invest  in  them.  This  inq}lies 
dut  die  community  must  carefully  understand  which  games  are  q^ropriate  for  the  various 
types  of  decisions  that  are  to  be  made. 

As  a  caveat,  he  raised  the  issue  of  the  false  promises  of  Anificial  Intelligence.  He  maintained 
that  AI  technology  was  so  oversold  that  h  is  perceived  by  many  in  the  community  as  being 
valueless,  or  worse.  Thus,  he  warned,  caution  should  be  exercised  in  advertising  the  utility 
of  war  games  and  in  ai^lying  these  tools  to  appropriate  issues. 

Mr.  Vaughn  observed  that  the  working  groups  had  identified  a  spectrum  of  issues  ranging  from 
well-defined  to  ill-defined.  He  maintained  that  technologically  sophisticated  wargaming  was 
least  q^licable  at  the  Hi-defined  end  of  the  spectrum  (e.g.,  formulating  technology  investment 
strategies).  For  those  issues,  he  noted,  seminar  techniques  will  dominate. 

D.  Mr.  "Bud"  Hay. 

Mr.  Hay  prefaced  his  remarks  by  noting  that  gaming  is  a  set  of  tools  that  can  be  used  to 
establish  more  rigorous  parameters  for  decision  making  than  "a  coffee  cup  and  a  cigar."  He 
observed  that  decision  makers  are  making  decisions  based  on  "best  guesses"  because  analytic 
tools  and  RDT&E  tools  do  not  fill  in  the  upper  range  of  realities  within  which  decisions  need 
to  be  made. 

Mr.  Hay  stated  that  die  major  issues  of  interest  are  inherently  multi-disciplinary,  requiring  the 
concerted  efforts  of  policy  makers,  the  techiucal  community,  and  the  operatiorud  community. 
However,  he  opined,  effective  interaction  among  these  conununities  is  hindered  by  some 
"truisms": 

1.  "Few  people  know  reality  today;  fewer  can  comprehend  the  future." 

2.  "Policy  makers  hate  technicians.” 

3.  "Technicians  think  policy  makers  are  stupid  (because  of  #2  above)." 

4.  "Operators  think  the  other  two  groups  are  irrelevant." 

Consequmtly,  he  observed,  in  order  to  perform  Mission  Area  Assessmoits,  it  is  necessary  to 
develop  a  conunon  working  hypothesis  of  present^ture  warfighting  situations.  Mr.  Hay 
recommended  that  wargaming  and  aiuilytic  techniques  be  employed  to  support  that  need. 

Mr.  Hay  noted  that  the  report  outs  from  the  working  groups  had  been  excellent,  particularly 
tile  presentation  by  the  working  group  on  "Wargaming  Hardware/Software  Capabilities  and 
Their  Inqilications."  He  particularly  endorsed  the  need  for  a  "tool  box"  to  support  the  flexible, 
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efficient  devdqijment  and  maintenance  of  war  games. 

E.  CAFT  John  Heidt. 

CAFT  Heidt  began  his  remarks  by  noting  that  he  had  anticqutted  die  workshop  widi  a  certain 
degree  of  trepidation.  However,  he  perceived  diat  a  great  deal  of  progress  had  been  made  at 
die  workshop  in  clarifying  what  war  games  were  and  what  they  can  do  for  you. 

He  noted  that  there  tends  to  be  a  conflict  with  individuals  who  have  a  "scientific  method 
mindset"  and  "yearn  to  force  wargaming  into  the  neat  litde  box  of  madmnatical  analysis." 
By  contrast,  he  opined  that  wargaming  is  more  in  the  business  of  understanding  human  nature. 
Cmisequendy,  he  perceived  it  to  be  hard  to  define  and  he  urged  practitioners  to  guard  against 
ill  use. 

Although  the  workshop’s  terms  of  reference  defined  wargaming  in  very  broad  terms,  CAFT 
Heidt  maintained  that  it  was  in^rtant  to  distinguish  between  man-in-die-loop  simulations  and 
war  games  drawing  on  systems  operators.  In  the  latter  case,  he  saw  wargaming  as  the 
interactive  simulation  of  conflict,  employing  decision  makers  on  both  sides,  exploring  the 
processes  of  conflict  through  human  interaction.  For  these  wargaming  tools,  he  maintained, 
it  is  not  possible  to  replicate  results.  He  concluded  diat  value  of  wargaming  steins  from 
its  organization  and  its  use  in  exploring,  educating,  and  explaining. 

F.  Mrs.  Betty  Gay. 

Mrs.  Gay  observed  that  a  key  role  of  wargaming  is  to  balance  and  facilitate  technology  pu^ 
and  requirements  pull.  In  that  sense,  she  noted,  wargaming  is  a  tool  for  communication 
between  the  operator/user  and  the  technologist/designer.  She  perceived  wargaming  to  be 
especially  valuable  in  working  the  fi-ont  end  problem  to  reduce  the  time  to  integrate  systems 
into  the  force  effectively.  However,  she  voiced  concern  about  the  use  of  wargaming  to 
develop  investment  strategies  for  basic  technology.  She  noted  that  many  expectations  for  war 
games  may  be  ill-advised  and  that  there  is  a  danger  that  wargaming  will  be  regarded  as  a 
"panacea”  in  the  way  that  systems  analysis  was  viewed  in  the  i960s. 

Mrs.  Gay  viewed  the  workshop  as  an  important  starting  point  that  needs  to  continue:  to 
address  many  of  the  limitations  identified;  to  share  information  on  what,  how,  iiqiuts,  etc; 
and  to  educate  users,  decision  makers,  and  designers.  She  concluded  that  the  challenge  is  for 
MORS  to  take  a  leadership  role  in  doing  the  above. 

G.  Dr.  Allan  Schell. 

Dr.  Schell  focused  on  technology  wargaming  and  the  problem  of  eliciting  "requirements  pull" 
for  technology.  He  observed  that  the  underlying  issue  is  to  link  the  parameters  of  new 
technology  to  the  value  that  technology  will  provide  when  employed  by  a  warfighting  force. 

The  first  task,  he  noted,  is  to  identify  the  customer  for  a  technology  war  game.  He  stated  that 
technology  gaming  must  be  valuable  to  the  decision  maker  who  is  to  select  among  technology 
alternatives,  rather  than  to  the  gamer. 
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Dr.  Sdwll  perceived  the  primary  value  of  the  war  game  to  be  the  develc^nnent  of  intuition 
for  the  choice  of  technologies  in  the  value  space  of  the  user-operator,  radier  than  die  precise 
prioritization  of  technology.  Consequ^dy,  he  stated  diat  the  primary  goals  of  technology 
wargaming  should  be  consensus  building,  the  development  of  commtm  percqiticMis,  and 
educatitm. 

Dr.  Schell  observed  that  a  critical  element  of  technology  wargaming  is  the  development  and 
application  of  a  useful  spectrum  of  future  scenarios.  He  noted  that  there  is  no  intrinsic  limit 
to  die  scope  of  wargaming  and  die  need  for  fidelity  should  not  necessarily  drive  to  ctnnplexity. 
However,  he  observed,  the  drive  ^uld  be  to  include  relevant  detail,  where  the  te^  for 
relevance  is  whether  it  affects  the  perception  of  the  value  of  the  technology  to  the 
tqierator^layer. 

Dr.  Schell  noted  that  an  excellent  role  for  wargaming  is  to  discern  the  relative  values  between 
increases  in  performance  and  increases  in  leliability/availability  of  new  technology.  He  stated 
that  there  is  a  perception  among  many  that  there  is  a  tradeoff  between  maintainability  and 
performance.  However,  he  maintained  that  this  is  not  so  and  that  mie  can  have  either  both 
or  neither. 

Dr.  Schell  stated  that  one  prime  qiplication  of  technology  wargaming  is  to  explore  how  the 
enqiloyment  of  new  technology  could  lead  to  radically  different  or  unfamiliar  wartighting 
processes.  As  an  example,  he  noted  that  electromagnetic  pulse  weapons  may  be  to  military 
hardware  what  chemical  weapons  are  to  troops.  He  observed  that  both  are  weapons  that 
"^ray"  something  on  an  opponent  which,  if  unprotected,  will  le^  to  degraded  warfighting 
capability.  He  noted  that  the  extent  of  disability  is  generally  unclear  at  the  time  of  "spraying.” 
Consequently,  he  stated,  there  is  major  uncertainty  about  the  utility  of  these  weapons  that 
requires  the  playing  of  war  games  to  support  their  eventual  prioritization. 

Dr.  Schell  observed  there  was  some  downside  risk  in  having  the  bureaucracy  use  war  games 
to  determine  the  battlefield  utility  of  systems.  However,  he  maintained,  that  in  view  of  the 
potential  benefits,  these  constituted  acceptable  risks.  Dr.  ScheU  concluded  his  remarks  by 
observing  that  the  limited  replicability  of  a  war  game  was  of  less  concern  than  the  need  to 
expand  the  thoughts  of  operators  so  that  they  realistically  covered  the  decision  makers’  sample 
space  of  interest. 

H.  ADM  Harry  Train. 

ADM  Train  began  his  remarks  by  touching  upon  the  philosophy  of  gaming.  He  noted  that 
although  war  games  carmot  replicate  reality,  it  is  still  important  to  inject  as  much  of  the  real 
world  situation  into  them  as  possible.  Ideally,  he  stated,  people  should  play  themselves  in  a 
war  game  in  order  to  C2q)ture  a  realistic  sense  of  accountability.  He  observed  that  if  that 
sense  of  accountability  is  not  achieved,  it  is  likely  to  skew  the  results  significantly. 

ADM  Train  reflected  on  tfie  war  games  in  which  he  participated,  early  in  his  career,  when 
{diysical  "pucks"  were  used  to  represent  forces.  He  noted  foat  these  artifacts  prompted  the 
required  soise  of  accountability.  He  observed  that  these  "pucks"  made  the  consequences  of 


any  decisioa  very  visible  (for  exan[q>le,  it  became  obvious  to  any  milooker  if  you  failed  to 
bring  along  oilers  or  if  you  brought  them  Imt  left  them  vulnerable  to  attack). 

ADM  Train  recmnmended  diat  war  games  never  be  advertised  as  being  "no  fault."  As  an 
example,  he  cited  Nifty  Nugget  whose  findings  led  to  the  establishmmt  of  the  Rqiid 
Deployment  Agency  and  Joint  Task  Forces.  He  observed  that  these  experiences  highlighted 
the  need  for  balanced  levels  of  accountability. 

ADM  Train  stated  that  die  workshop  had  not  addressed  the  full  spectrum  of  war  games.  As 
an  example,  he  noted  that  die  SecDef  would  fiequendy  employ  a  war  game,  in  the  foim  of 
a  "murder  board,"  before  testifying  to  Ccmgress. 

ADM  Train  concluded  his  remarks  by  citing  some  "buzzwords"  in  the  wargaming  commumty 
that  tend  to  obfuscate  the  underlying  issue.  For  exan^le,  he  noted,  the  community  speaks  of 
"data"  and  "data  bases"  when  they  should  be  talking  about  "facts".  He  observed  die 
community  tends  to  describe  a  Red  salient  into  Blue  as  a  "target  rich  environment".  That 
phrase  may  not  adequately  crqiture  the  nature  of  the  problem.  (Note:  ADM  Train’s  notes, 
which  conqilement  his  oral  remarks,  are  included  as  Annex  A  and  follow  this  section.) 
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ANNEX  A 

INITUL  DRAFT  COMMENTS  BY  ADMIRAL  HARRY  TRAIN 


Scope  of  workshop  narrowly  limited  to  the  envelope  aroutKl  acquisition,  technology,  t^ 
and  evaluation,  and  supporting  h^ware/software. 

Wargaming  (gaming  in  corporate  world)  can  be  designed  in  a  continuum  bounded  by  a 
100  percent  AI  game  with  no  human  interactitm  at  the  high  tech  end  to  a  100  percent  seminar 
game  at  the  high  human  end. 

% 

The  higher  the  rank  of  the  players  the  closer  a  war  game  ^ign  must  iq)proach  die  pure 
seminar  game  end  of  the  continuum. 

A  pure  seminar  game  can  have  high  technical  validity. 

The  closer  a  war  game  approaches  the  operator^ilot/tank  driver  the  less  defined  the 
line  between  simulation  and  wargaming  and  the  higher  the  hardware/software  support  of  the 
gaming  process. 

Even  within  die  narrow  topical  envelope  of  d^  workshop,  the  product  of  a  game  can 
range  from  educating  gamers  and  players  to  "down  selecting"  candidate  acquisition  systems. 

There  is  full  agreement  within  the  wargaming  community  diat  gaming,  at  any  level  of 
detail,  provides  "insights"  into  the  subject  being  gamed.  There  is  little  agreement  that  gaming 
can  "validate"  the  subject  matter.  An  issue  is  the  inability  of  games  to  demonstrate 
repeatability. 

The  workshop  focused  almost  entirely  on  the  acquisition  of  things  and  technologies. 
There  was  no  discussion  of  gaming  of  doctrine,  tactics  or  strategy. 

Ultimately,  hardware  and  software  projected  developments  can  meet  any  projected  needs 
excqit  solving  (or  replicating)  chaos. 

In  designing  a  game  the  sponsor  needs  to  clearly  state  his  objective: 

Should  the  Navy  buy  weapon  A  or  weapon  B? 

Should  the  Navy  accelerate  research  on  fuel  cell  batteries  for  subnuirines? 

Should  the  Navy  alter  its  forward  deployed  strategy  in  light  of  Glastnost  budget  cuts? 

Is  FOFA  technology  limited? 

The  game  designer  needs  access  to  the  sponsor. 

The  level  of  players  ought  to  match  the  game’s  objectives. 

Tlwre  is  a  philosophy  of  gaming  which  is  important  in  bridging  credibility  and  fidelity. 
Games  in  times  past  where  players  physically  moved  pucks  after  player  deliberations  seemed 
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to  enhance  the  link  between  move  and  the  consequences  of  that  move.  Cunent  games  where 
moves  ate  made  cm  a  conqniter  screen  blur  the  sense  of  accountability  of  the  players. 

USDA’s,  Vice  Chaimwn  JCS,  OP098s,  and  the  like  need  some  form  of  staff  expertise 
in  wargaming  capabilities  available  to  them.  More  often  than  not  a  need  will  go  unaddressed 
while  a  cq>ability  to  game  goes  unemployed.  This  is  equally  tme  at  the  Systems  Command 
level  and  die  Program  Manager  level  and  is  probably  trae  at  OPTEVFOR  level. 

Gaming  must  be  keyed  to  the  output  or  product.  Gaming  for  the  sake  of  gaming  should 
be  of  interest  only  to  Ted  Koj^l. 

Within  diis  context,  the  workshop’s  recommendations  for  a  waigaming  clearinghouse 
and  common  wargaming  tool  sets  could  have  high  pay-off  if  inqilemented,  but  leads  to  the 
questirm,  who  will  supervise,  monitor  or  discipline  this  process? 
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APPENDIX  G 

WORKSHOP  BACKGROUND 


TERMS  OF  REFERENCE  (TOR)  SUMMARY 


MORS  Workshop 
on 

Future  Wargaming  IDevelopments 

5-7  December  1989 
Naval  War  College 
Newport,  Rhode  Island 


Workshop  Chairman: 

Dt.  Dale  K.  Pace 

Hoiddns  University  Applied  Physics  Laboratory 
Liaison  with  the  Naval  War  College 

Wodcshop  Hosts: 

Dr.  Robert  S.  Wood,  Dean 

Center  for  Naval  Warfare  St^dies/Naval  War  College 

CAFT  John  H.  Heidt,  Director 

War  Gaming  Departmott,  Naval  War  CoUege 

BACKGROUND 

The  wargaming  environment  is  changing.  Hardware/software  improvements  are  bringing  both 
new  <q>portunities  and  new  challenges  to  wargaming.  In  addition,  wargaming  has  begun  to 
be  tilled  to  areas  that  are  relatively  novel  for  it,  such  as  force  architecture  and  technology 
issues.  It  is  expected  that  waigaming  will  play  a  larger  part  in  future  testing  and  evaluation 
(T&E),  especially  as  T&E  is  qtplied  to  force  level  and  force  architectural  issues.  Thus,  there 
is  great  need  for  a  wargaming  woikshop  to  address  state-of-the-art  issues  that  result  from  this 
changing  environment. 

"Wargaming”  has  a  multitude  of  coimotations.  This  woikshop  will  assume  a  very  broad 
definiticm  for  the  teim.  It  will  accept  as  waigaming  any  form  of  research,  analysis,  training, 
educatimi,  or  recreation  that  is  intended  to  produce  bener  appreciation  forAmderstanding  of 
warfare,  which  involves  people  directly  in  the  computation/gaming  process  who  function  as 
people  in  the  process  or  who  serve  as  a  surrogate  for  some  other  an^ytic  processes  (such  as 
using  expert  judgment  by  a  game  umpire  to  evaluate  force  interaction  or  batde  damage).  Such 
a  broad  cruinotation  for  wargaming  removes  opportunities  for  quibbling  over  what  is 
waigaming  or  what  is  something  else.  This  de^tion  excludes  computer  simulation  or 
closed-form  mathematical  analysis  of  combat  which  does  not  involve  a  human  directly  in  the 
conqwtation  process.  Such  simulations  and  closed-form  mathematical  analyses  can  be  used 


in  wargaming,  but  singly  in  thonselves  are  not  war  games  by  this  definition.  However,  the 
woikdu^  will  include  computer  simulations  using  expert  system  or  other  artificial  intelligoice 
techniques  to  rqnesent  huii^  decision-making  as  war  games,  evoi  if  a  human  is  not  directly 
involved  in  die  conqiutation  process. 

Because  of  the  nuuiy  varied  fornis  and  uses  of  wargaming,  it  is  necessary  to  provide  a  brief 
constract  of  wargaming  techniques,  uses,  and  status  so  that  workshop  objectives,  sc(^,  and 
methodology  can  be  understood  clearly. 


Wargamin>^  Techniqne.s!  There  are  many  forms  and  techniques  which  can  be  used  in 
wargaming.  Some  dimensions  of  wargaming  techniques  are  listed  below: 


1.  Format: 

a.  Closed  (players  know  only  game  truth) 

b.  Open  (players  have  access  to  ground  truth) 

c.  Partially  (Hosed/Open  (some  players  know  more  than  game  tmth) 

d.  Seminar 

e.  Mixture  of  all  formats 

2.  Number  of  sides:  One-sided,  Two-sided,  Multi-sided 

3.  Level  of  control:  Free-play  or  otherwise 

4.  Level  &.  kind  of  hardware/software  support  for  the  game 

a.  None 

b.  Situation  &  interaction  (e.g.,  BDA)  calculations 

c.  Situation  &.  interaction  displays  in  "game  format" 

d.  Situation  Sc.  interaction  di^lays  in  simulated  facilities 

e.  Use  of  real  equipments/facilities  (e.g.,  "hardware  in  the  loop") 

f.  Use  of  artificial  intelligence  (AI) 

g.  Combinations  of  above 

5.  Level  and  kind  of  data  collection,  in^st-game  analysis  of  game  data 

6.  Interaction  with  other  forms  of  analysis,  operations,  testing,  etc. 


Wargaming  Uses  of  Potential  Interest  for  the  Workshop:  There  are  many  possible  uses  for 
wargaming.  They  can  be  categorized  in  many  different  ways.  Four  general  categories  of  uses 
which  cover  potential  areas  of  interest  for  Ae  workshop  are  identified  below.  This  list  is 
intended  to  be  illustrative. 

1.  To  train  personnel.  This  use  includes  simulators  as  a  form  of  wargaming  by 

the  above  definition. 

2.  To  educate  persotmel. 

3.  To  analyze,  evaluate,  or  test  the  following  kinds  of  items: 

a.  War  plans 

b.  Operational  concepts 

c.  Tactics  and  strategies 

d.  Systems  (including  functioning  as  part  of  T&E) 

e.  Scenarios 


no 


4. 


To  provide  insights  about  the  militaiy  utility,  etc.,  of: 

a.  Systems  and  their  interactions 

b.  Technologies 

c.  Investment  strategies  (force  procurement,  R&D,  etc.) 

d.  Acquisition  policies 

e.  Maiq)ower 

f.  Organizational  structures 

Status  of  Wargaming!  Training  and  education  uses  of  wargaming  are  the  best  understood 
aspects  of  wargaming.  These  uses  are  reasonably  well  docunwnted  in  extant  wargaming 
literature,  e^cially  for  wargaming  enq>loying  traditional  hardware  and  software  sui^rt  for 
the  gaming  processes.  Uses  of  wargaming  in  T&E  and  for  insights  about  dw  fourth  category 
above  are  not  yet  well  understood  and  have  been  discussed  relatively  little  in  die  extant 
literature. 

OBJECTIVES  &  SCOPE 

The  two  primary  objectives  of  the  woiksht^  will  be  to  identify,  define,  and  clarify: 

(1)  qqiropriate  limitations  upon  and  ciqiabilities  of  wargaming  applications  relative  to  the 
following  (listed  in  order  of  priority): 

a.  Technology  issues  (especially  development  of  the  theory  of  and  guidelines  for 
the  practice  of  "technology  gaming"), 

b.  Wargaming  use  in  T&E, 

c.  System  interactions  in  operational  contexts, 

d.  Werqxm  acquisition  processes, 

e.  Marqwwer  planning,  and 

(2)  changes  desirable  in  wargaming  processes  because  of  anticipated  hardware  and  software 
advances  within  die  next  5-10  years. 

Past  wargaming  practice  will  be  used  to  provide  insight  about  desirable  changes  in  wargaming 
methodology  to  best  acctmimodate  novel  ai^licatitnis  of  wargaming  or  hardware/software 
advances.  Documentation  of  insights  about  common  (past  or  current)  wargaming  pitfalls  and 
suggested  ways  to  avoid  them  will  be  a  secondary  objective  of  the  workshop. 

Because  effective  ipplicatitm  of  war  games  to  novel  topic  areas,  such  as  those  identified 
above,  requires  that  tte  war  games  be  imbedded  within  the  context  of  a  larger  decision-making 
process,  die  ways  that  war  games  (their  planning,  conduct,  results,  and  impact)  can/should 
interact  with  such  decision-making  processes  will  be  as  inqiortant  in  this  workshop’s 
discussitms  as  consideration  of  specific  ways  such  war  games  should  be  done. 

The  focus  of  this  workshop  is  on  methodology.  It  will  be  conducted  at  the  SECRET 
NOFORN  level  of  classification  in  order  to  idlow  maximum  use  of  recent  wargaming 
experience  to  be  used  to  illustrate  both  theoretical  and  practical  aspects  of  wargaming 
qiplications.  Of  particular  inqiortance  is  the  issue  of  how  higher  classification  aspects  of  a 
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game  conducted  at  a  lower  classification  level  can  be  used  without  unduly  limiting  or 
ccnnpromising  the  validity  of  game  results  and  insights. 

METHODOLOGY  &  STRUCTURE 

A  read-ahead  package  will  be  provided  to  each  workshop  paitic^ant.  The  read-ahead  package 
is  expected  to  include;  1)  an  assessment  of  current  wargaming  hardware  and  software 
capabilities,  2)  an  estimation  of  similar  capabilities  for  S-10  years  hence,  3)  ps^rs  on 
technology  gaming,  especially  reports  of  such  endeavors  within  the  past  several  years,  4)  a 
btbliogrq>hy  of  materials  pertinent  to  the  woikshop,  S)  predictions  of  how  wargaming  may  be 
used  in  T&E  within  the  next  5-10  years,  and  6)  specific  goals  for  each  of  the  woik^op 
groups.  These  goals  will  provide  a  structure  for  group  discussitms  within  the  workshop,  a 
starting  point  for  each  of  foem.  This  structure  is  intended  to  restrict  discussion  within  the 
groups,  but  will  be  designed  to  ensure  that  a  corpus  of  significam  material  will  result  from 
the  woikshop.  Each  of  the  major  points  considered  within  the  groups  will  be  addressed  from 
the  viewpoints  of  users  of  wargaming  results,  war  gamers,  and  non-wargaming  analysts. 

Woikshop  partk^ants  will  be  divided  into  four  groiips  of  8-10  persons.  The  topics  for  the 
four  groups  are: 

1.  Waigaming  Hardware/Softwaie  Crqrabilities  and  their  Implications 
Leaders:  LtCol  Alan  D.  Dunham  (DARPA) 

Ms.  Barbara  G.  Toohill  (MITRE) 

2.  Waigaming  and  Technology  Issues 

Leaders:  Mr.  Joseph  Lacetera  (USA  LABCXJM) 

Dr.  James  Tiitten  (Naval  Postgraduate  School) 

3.  Waigaming,  T&E,  and  System  Interactions  in  Operational  Contexts 
Leaders:  Maj  David  Hemingway  (Army  Air  Defense  Artillery  School) 

Mr.  Ken  Lavoie  (Air  University  Wargaming  Onter) 

4.  Waigaming ’s  Role  in  Manpower  Planning  &  Weapons  Acquisition 
Leaders:  LtCol  Bruce  Smith  (USAF/SA) 

LtCol  David  Thomen  (USMC  Waigaming  &  Assessment  Center) 

Each  group  within  the  woikshop  will  both  discuss  its  specific  topics  and  report  its  findings 
to  the  woikshop  as  a  whole.  This  will  enable  all  participants  to  share  the  insights  and 
perspectives  gained  by  each  group  and  prevent  any  group  from  long  maintaining  too  limited 
a  perspective  about  its  assigned  topics.  The  frnal  plenaiy  session  of  the  woikshop  will  seek 
to  clearly  idratify  those  areas  of  consensus  from  woikshop  participants  and  those  areas  within 
which  significant  disagreements  exist.  A  data  collection  process  will  be  employed  which 
obtains  both  outputs  from  the  groups  and  from  individual  woikshop  participants. 

Results  frtnn  the  woikshop  will  be  briefed  to  the  MORS  Sponsors.  The  wodcshop  will  provide 
a  rqx>rt  of  its  proceedings,  which  will  be  entered  into  the  Defense  Technical  Information 
Center.  It  is  expected  that  some  of  the  woikshop  participants  will  draw  upon  insights  gained 
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in  the  wcnkshop  to  produce  a  number  of  pq)ers  and  otho*  publications  (m  wargaming,  such 
as  a  monogrqih  or  bode  on  technology  gamii^. 

READ-AHEAD  PACKAGE  USTING 

The  Read- Ahead  Package  provided  for  partic^ants  in  the  MORS  Future  Wargaming 
Developinents  Workshop  cmisisted  of  the  eight  items  identified  below: 

Item  1:  Terms  of  Reference  (TOR)  for  the  Workshq>. 

Item  2:  A  statement  of  the  Workshop  Chairman’s  expectations. 

Item  3:  A  bibliognq)hy  of  materials  related  to  wargaming  taken  from  the  then  to  be 
publiahed  bode  by  Dr.  Peter  P.  Perla,  "The  Art  of  Wargaming”  (Naval  Institute  Press,  1990). 

Item  4:  A  dtort  strawman  paper  about  hardware  and  software  gaming  suj^rt  c^abilities 
expected  S-10  years  hence  (prepared  by  Mr.  Bob  McIntyre  of  STI,  in  conjunction  with  the 
DARPA  Distributed  Wargaming  Project). 

Item  S:  A  short  strawman  paper  about  wargaming  use  in  T&E  (prq>ared  by  Dr.  Adelia 
Ritchie  of  SAIC,  formerly  of  OUSDT&E). 

Item  6:  "Policy  Guidance  for  the  Application  of  Modeling  and  Simulation  in  Suppon  of 
Operational  Test  and  Evaluation,"  OSD(OT&E),  January  1989. 

Item  7:  Technology  Initiatives  89  Game:  Methodology  CeU  Report  (Naval  War  College,  15 
September  1989). 

Item  8:  RAND  Piper  p-7593,  "Toward  an  Assessment  of  Technology  Gaming,"  by  Dr.  James 
Dewar  (August  1989). 
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